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PREFACE 

This  technical  report  presents  the  evaluation  procedures,  concepts,  and  results  from 
the  MAX  GAP  test  project.  The  United  States  Air  Force  Test  Pilot  School  (USAF  TPS) 
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Force  Flight  Test  Center,  Edwards  Air  Force  Base,  California.  Both  the  USAF  TPS  and  the 
Air  Force  Institute  of  Technology  (AFTT)  sponsored  this  project. 

The  MAX  GAP  Test  Team  would  like  to  thank  Mr.  Curt  Clark  and  Mr.  Jeff  Slutz  of 
AFRL/VACD  who  worked  diligently  to  ensure  our  success  in  the  LAMARS  simulator.  We 
would  also  like  to  thank  Mr.  Andy  Markofski  and  Mr.  Mike  Steen  of  Veridian  Flight 
Research  for  their  outstanding  contributions.  Additionally,  we  would  like  to  thank  the  entire 
NF-16D  VISTA  maintenance  team  for  their  dedication  to  ensuring  our  program  success. 
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EXECUTIVE  SUMMARY 

This  Technical  Report  presents  the  results  of  the  flight  test  of  the  MAX  GAP  project. 
The  objectives  of  the  project  were  to  correlate,  if  possible.  Pilot-induced  Oscillation 
Tendency  Ratings  with  a  new  preflight  calculation  called  the  Gap  Criterion  and  to  collect 
and  analyze  historical  simulator  and  flight  test  data  as  well  as  to  compile  new  simulator  and 
flight  test  data  to  augment  this  database. 

The  responsible  Test  Organization  was  the  412*  Test  Wing.  The  MAX  GAP  Test 
Team,  members  of  the  United  States  Air  Force  Test  Pilot  School  (USAF  TPS)  Class  03A, 
accomplished  all  test  and  evaluation  sorties. 

Pilot-induced  Oscillations  (PIO)  are  an  unwanted  pilot  plus  aircraft  oscillation.  There 
are  many  causes  for  this  unwanted  motion,  one  of  which  is  actuator  rate  limiting.  Actuator 
rate  limiting  is  a  non-linear  phenomenon  caused  by  the  pilot  and/or  flight  control  system 
(FCS)  demanding  more  actuator  performance  than  the  actuator  can  produce.  The  result  is  a 
reduction  in  magnitude  of  the  output  and  a  phase  shift  between  the  pilot/FCS  input  and  the 
actuator  output.  This  interaction  can  drive  the  system  toward  a  limit  cycle  of  PIO. 

The  Gap  Criterion  is  a  preflight  calculation  based  on  a  linear  representation  of  the 
bare  airframe  aircraft  dynamics  and  a  Neal-Smith  pilot  model  and  a  non-linear  representation 
of  a  simple  rate-limited  actuator  model.  This  simple  non-linear  model  can  be  represented  by 
a  describing  function.  Using  these  tools,  a  new  criterion  called  the  Gap  Criterion  can  be 
computed  which  may  relate  to  PIO  tendency  rating. 

The  MAX  GAP  Test  Team  applied  the  Gap  Criterion  to  historical  simulator  and 
flight  test  data  and  to  data  gathered  during  this  project.  The  Large  Amplitude  Multimode 
Aerospace  Simulator  (LAMARS)  at  Wright-Patterson  AFB,  OH  and  the  NF-16D  Variable 
In-flight  Simulator  Test  Aircraft  (VISTA)  operated  by  the  USAF  Test  Pilot  School  at 
Edwards  AFB,  CA  were  used  to  collect  this  data. 

Overall  results  confirmed  a  correlation  between  Gap  Criterion  and  PIO  Tendency 
Rating.  All  four  Phase  2  Handling  Qualities  unaltered  datasets  and  five  out  of  seven  Phase  3 
datasets  showed  correlation  with  at  least  95%  confidence. 
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INTRODUCTION 

A  newly  developed  metric  called  the  Gap  Criterion  was  compared  to  Pilot-induced 
Oscillation  (PIO)  tendency  ratings  to  determine  if  any  correlation  exists.  The  United  States 
Air  Force  Test  Pilot  School  (USAF  TPS)  Class  03A  MAX  GAP  Test  Team  analyzed 
historical  simulator  and  flight  test  data  from  Projects  HAVE  OLOP  (Reference  1)  and  HAVE 
PREVENT  (Reference  2).  The  test  team  gathered  additional  simulator  data  using  the  Large 
Amplitude  Multimode  Aerospace  Research  Simulator  (LAMARS)  located  at  Wright- 
Patterson  AFB,  OH.  Flight  test  data  were  collected  using  the  NF-16D  Variable  In-flight 
Simulator  Test  Aircraft  (VISTA)  at  the  Air  Force  Flight  Test  Center  (AFFTC),  Edwards 
AFB,CA. 


Background 

Pilot-induced  Oscillations  are  an  unwanted  pilot  plus  aircraft  oscillation.  There  are 
many  causes  for  this  unwanted  motion,  one  of  which  is  actuator  rate  limiting.  Actuator  rate 
limiting  is  a  non-linear  phenomenon  caused  by  the  pilot  and/or  flight  control  system  (FCS) 
demanding  more  actuator  performance  than  the  actuator  can  produce.  The  result  is  a 
reduction  in  magnitude  of  the  output  and  a  phase  lag  between  the  pilot/FCS  input  and  the 
actuator  output.  This  interaction  can  drive  the  system  toward  a  limit  cycle.  These  effects  are 
shown  by  the  triangular  elevator  response  depicted  in  Figure  1. 


Figure  1.  Example  of  Elevator  Rate  limiting 


The  Gap  Criterion  is  a  preflight  calculation  based  on  a  linear  representation  of  the 
augmented  and  bare  airframe  aircraft  dynamics  and  a  Neal-Smith  pilot  model,  MIL-HDBK- 
1797  (Reference  3)  and  a  non-linear  representation  of  a  simple  rate-limited  actuator  model. 
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This  simple  model  can  be  represented  by  a  describing  function.  For  a  limit  cycle  to  exist,  the 
magnitude  and  phase  of  the  frequency  response  of  the  combined  linear  dynamics  must  equal 
the  negative  inverse  of  the  magnitude  and  phase  of  the  describing  function  in  at  least  one 
intersection.  Most  sets  of  stable  aircraft  dynamics  convolved  with  their  optimum  Neal-Smith 
pilot  model  do  not  ordinarily  intersect  with  the  describing  function.  Therefore,  the  pilot  gain 
is  artificially  inflated  to  cause  the  intersection.  At  this  intersection,  the  amplitude  and 
frequency  of  the  PIO  input  can  be  determined.  The  Gap  Criterion  is  the  product  of  the 
inflated  gain  and  the  input  amplitude  normalized  by  the  maximum  available  actuator 
deflection.  A  detailed  derivation  of  the  Gap  Criterion  is  shown  in  Appendix  A. 

The  PIO  Tendency  Classification  scale  of  MIL-HDBK-1797  (Reference  3)  shown  in 
Figure  Cl  of  Appendix  C  was  used  in  this  test.  This  decision  tree  was  augmented  with  the 
additional  MIL-HDBK-1797  descriptors  shown  in  Appendix  C. 

This  project  performed  a  PIO  investigation  for  various  combinations  of  bare  airframe 
dynamics  and  actuator  rate  limits.  This  investigation  was  divided  into  three  parts:  Phase  1, 2, 
and  3.  The  Phase  1  investigation  consisted  of  open  loop  and  gentle  tracking  maneuvers  to 
evaluate  low  (pilot)  gain,  low-bandwidth  handling  qualities.  Some  example  maneuvers 
included  doublets,  step  inputs,  and  pitch  angle  captures.  Phase  2  testing  is  an  evaluation  of 
high  gain,  high  bandwidth  handling  qualities.  It  uses  a  specialized  technique,  called 
Handling  Qualities  During  Tracking  (HQDT),  requiring  the  pilot  to,  “track  a  precision  aim 
point  on  a  target  as  aggressively  and  assiduously  as  possible,  always  striving  to  correct  even 
the  smallest  tracking  errors  as  rapidly  as  possible.”  (Reference  4)  HQDT  is  the  most  reliable 
method  of  determining  PIO  susceptibility.  A  Sum-of-sines  HUD  tracking  task  was  used  for 
Phase  2.  During  Phase  3  testing,  the  test  pilot  performed  an  operational  evaluation  of  the 
aircraft’s  PIO  susceptibility.  For  this  project,  the  Phase  3  evaluation  alternated  between  a 
discrete  pitch-tracking  task  with  the  HUD  symbology  shown  in  Figure  3  and  an  aircraft  target 
tracking  task. 


PROGRAM  CHRONOLOGY 

The  MAX  GAP  Test  Team  began  with  applying  the  Gap  Criterion  to  historical 
simulator  and  flight  test  data  from  similar  PIO  studies  HAVE  PREVENT  (DEC  2002)  and 
HAVE  OLOP  (DEC  2000).  Next,  the  test  team  gathered  PIO  tendency  rating  data  using  the 
Large  Amplitude  Multimode  Aerospace  Simulator  (LAMARS),  Wright-Patterson  AFB,  OH 
on  21-22  August  2003.  Following  the  LAMARS  testing,  flight  tests  were  conducted  in  the 
NF-16D  Variable  In-flight  Simulator  Test  Aircraft  (VISTA)  at  the  Air  Force  Flight  Test 
Center  (AFFTC)  at  Edwards  AFB,  CA  from  17-22  October  2003.  In  total,  one  calibration 
sortie,  eight  test  sorties  and  five  target  sorties  were  executed,  totaling  17.7  hours. 


TEST  ITEM  DESCRIPTION 

The  test  item  evaluated  was  the  Gap  Criterion  and  its  possible  correlation  to  PIO 
tendency  ratings.  The  maximum  elevator  deflection  rates  selected  were  15,  30  and  60 
deg/sec.  A  cross-section  of  bare  airframe  short  period  natural  frequencies  and  damping  ratios 
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using  these  maximum  elevator  deflection  rates  were  selected  to  determine  a  range  of  Gap 
Criteria.  Subsequently,  four  bare  airframe  test  cases  with  different  short  period  properties 
were  selected  which  yielded  a  distributed  range  of  Gap  Criteria.  For  specific  details  on  the 
derivation  of  the  Gap  Criterion  and  rate  limit/airframe  dynamics  combinations  see 
Appendices  A  and  D. 

TEST  OBJECTIVES 


Overall  Objective 

To  determine  if  there  is  a  correlation  between  computed  Gap  Criterion  values  and  the 
resultant  PIO  Tendency  Rating  assigned  to  the  combination  of  bare  airframe  dynamics  and 
maximum  elevator  deflection  rates. 


Specific  Test  Objectives 

To  achieve  the  overall  test  objective,  a  three  phase  program  was  developed  with  each 
phase  having  specific  objectives: 

Test  Objective  1:  Determine  the  correlation  between  PIO  tendency  rating  and  Gap  Criterion 
using  historical  PIO  data. 

Test  Objective  2:  Determine  the  correlation  between  PIO  tendency  rating  and  Gap  Criterion 
using  the  LAMARS  simulator. 

Test  Objective  3:  Determine  the  correlation  between  PIO  tendency  rating  and  Gap  Criterion 
using  the  NF-16  VISTA. 


All  specific  test  objectives  were  met. 
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TEST  AND  EVALUATION 

The  objective  of  this  program  was  to  evaluate  a  new  criterion  for  predicting  PIO 
Tendency  Rating  for  rate-limited  actuators.  This  criterion  was  called  the  Gap  Criterion  and 
was  based  on  describing  function  techniques.  The  project  compared  assigned  PIO  tendency 
ratings  for  various  combinations  of  bare  aircraft  dynamics  and  actuator  rate  limits.  These 
combinations  are  described  in  detail  in  Appendix  D.  The  evaluation  criteria  used  in  this  test 
to  determine  quality  of  the  correlation  are  shown  in  Table  1 


Table  1:  Evaluation  Criteria 


<80% 

UNSATISFACTORY 

80%  -  95% 

MARGINAL 

>  95% 

SATISFACTORY 

Historical  data 

The  first  objective  was  to  determine  the  correlation  between  PIO  tendency  rating  and 
Gap  Criterion  using  historical  PIO  data 


Historical  data  procedures 

The  Gap  Criterion  was  computed  based  on  the  selected  bare  airframe  dynamics  of 
Projects  HAVE  PREVENT  and  HAVE  OLOP  (see  Appendix  D).  These  values  were 
matched  with  the  assigned  PIO  tendency  ratings.  The  correlation  coefficient  between  the 
assigned  PIO  tendency  rating  and  the  computed  Gap  Criterion  was  determined  as  described 
in  Appendix  B. 


Historical  data  results 

The  recorded  PIO  tendency  ratings  for  each  task  were  plotted  against  the  corre¬ 
sponding  Gap  Criterion  value  (Appendix  F).  A  linear  curve  fit  was  applied  to  the  data  to 
determine  the  correlation  coefficient.  This  correlation  coefficient  was  compared  to  the 
minimum  correlation  coefficient  needed  to  indicate  if  a  relationship  between  the  assigned 
PIO  tendency  ratings  and  the  Gap  Criterion  existed.  Both  80%  and  95%  confidence  level 
minimum  correlation  coefficients  were  computed  based  on  dataset  size.  For  purposes  of  this 
evaluation,  an  actual  correlation  coefficient  greater  than  the  95%  confidence  minimum 
correlation  coefficient  was  considered  satisfactory,  greater  than  the  80%  confidence 
minimum  correlation  coefficient  was  considered  marginal  and  less  than  80%  confidence  was 
unsatisfactory.  Table  2  shows  a  summary  of  these  historical  results. 


6 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDUM 


Table  2:  Summary  of  Historical  data  results 


Project  Have 
Prevent 

Phase  2 

Sum  of  Sines 

30 

0.241 

0.361 

0.585 

YES 

SATISFACTORY 

Phase  3 
Discrete 

19 

0.308 

0.456 

0.596 

YES 

SATISFACTORY 

Phase  3 

Target 

Tracking 

12 

0.398 

0.576 

0.394 

MINOR 

UNSATISFACTORY 

Project 

HAVE 

OLOP 

Phase  2 

Sum  of  Sines 

72 

0.153 

0.232 

0.477 

YES 

SATISFACTORY 

Phase  3 
Discrete 

77 

0.148 

0.224 

0.460 

YES 

SATISFACTORY 

The  values  for  Tmin  represent  the  minimum  required  value  of  the  correlation  coefficient  for  the  stated  level  of  confidence 


The  results  listed  in  Table  2  demonstrate  that  four  out  of  five  historical  datasets 
indicate  a  correlation  exists  between  Gap  Criterion  and  PIO  Tendency  Rating  with  at  least 
95%  confidence.  The  racmai  result  from  the  Phase  3  Target  Tracking  data  of  Project  Have 
Prevent  equates  to  a  79.5%  confidence  level  that  a  correlation  exists,  just  barely  missing  a 
marginal  rating. 


Simulator  data 

The  second  objective  was  to  determine  the  correlation  between  PIO  tendency  rating 
and  Gap  Criterion  using  the  LAMARS. 

Simulator  procedures 

PIO  tendency  ratings  for  each  combination  of  bare  airframe  dynamics/FCS  and 
actuator  rate  limit  listed  in  Appendix  D  were  collected  using  a  sum-of-sines  HUD  pitch¬ 
tracking  task  during  Phase  2  evaluation  and  either  a  discrete  HUD  pitch-tracking  task  or  an 
aircraft  toget-tracking  task  during  Phase  3  evaluations.  These  tasks  were  performed  in  the 
LAMARS  ground  simulator.  The  simulated  conditions  were  15,000  ft  pressure  altitude  and 
300  KIAS.  The  test  points  were  randomly  ordered  and  the  test  pilot  was  unaware  of  the 
configuration  being  flown.  Graphical  descriptions  of  the  sum-of-sines  and  discrete  HUD 
pitch-tracking  task  are  shown  in  Appendix  E.  The  gain  of  the  pitch  angle  MIL-HDBK-1797 
pitch  tracking  task  was  increased  250%  to  increase  pilot  workload  and  bandwidth.  The 
aircraft  target-tracking  task  consisted  of  a  simulated  aircraft  at  constant  speed,  3g  turn  with 
preprogrammed  reversals.  Several  gross  acquisition  captures  were  conducted  during  the 
duration  of  the  task  to  determine  PIO  tendency  rating.  Differing  PIO  tendency  ratings  were 
expected  due  to  differing  pilot  opinion.  What  was  not  expected  or  desired  was  variability  in 
ratings  from  the  same  test  pilot,  on  the  same  test  case,  performing  the  same  task.  Prior  to  the 
LAMARS  sorties,  in  an  effort  to  reduce  this  type  of  variability,  the  test  pilots  “calibrated” 
themselves  using  a  fixed-base  simulator  located  at  the  USAF  Test  Pilot  School  conducting 
Phase  1  and  Phase  2  evaluations  on  known  good  and  bad  aircraft  configurations.  This 
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calibration  proved  useful  in  identifying  the  indications  of  PIO  and  increasing  proficiency  in 
the  use  of  PIO  tendency  rating  scales.  See  Appendix  K  for  lessons  learned. 


Simulator  Results 

The  recorded  PIO  tendency  ratings  for  each  task  were  plotted  against  the  corre¬ 
sponding  Gap  Criterion  values.  A  correlation  coefficient  was  computed  (Appendix  B)  to 
determine  if  a  correlation  exists  between  the  two  values.  Table  3  shows  a  summary  of  the 
LAMARS  simulation  results. 


Table  3:  Summary  of  LAMARS  results 


•ri.siOGj'gftitm  '  -'i 

Phase  2 

Sum  of  Sines 

66 

0.160 

0.242 

0.337 

YES 

SATISFACTORY 

Phase  3 
Discrete 

49 

0.186 

0.281 

0.327 

YES 

SATISFACTORY 

Phase  3 

Target  Tracking 

44 

0.197 

0.297 

0.469 

YES 

SATISFACTORY 

The  values  for  Tmin  represent  the  minimum  required  value  of  the  correlation  coefficient  for  the  stated  level  of  confidence 


From  the  results  in  Table  3  it  can  be  stated,  with  95%  confidence  that  a  correlation 
exists  between  PIO  tendency  rating  and  the  corresponding  Gap  Criterion  values.  This 
evaluation  was  true  for  all  three  tasks  evaluated. 

Figures  in  Appendix  G  show  the  PIO  tendency  rating  vs.  Gap  Criterion  raw  data  for 
each  task  completed  in  the  LAMARS.  There  were  numerous  instances  where  identical  PIO 
tendency  ratings  were  given  for  a  specific  Gap  Criterion  value.  Looking  specifically  at 
Figure  Gl,  which  shows  the  LAMARS  data  for  a  Phase  2  Sum-of-Sines  task,  there  are 
several  data  points  that  support  the  Gap  Criterion  theory.  The  first  example  is  a  data  point 
with  a  small  Gap  Criterion  value.  For  this  data  point  during  Phase  2  evaluations  there  were 
five  instances  where  test  pilots  assigned  a  PIO  tendency  rating  of  5.  Looking  at  the 
associated  stripcharts  (Figure  G4),  in  all  cases  the  aircraft  response  was  out  of  phase  with 
pilot’s  inputs  and  rate  limiting  was  present.  The  second  example  is  a  data  point  with  a  large 
Gap  Criterion  value.  The  PIO  tendency  ratings  assigned  for  this  Gap  Criterion  varied  from 
1-6.  There  were  two  occurrences  where  a  PIO  tendency  rating  of  1  was  assigned  along  with 
one  2, 4, 5  and  6.  Looking  at  the  associated  stripcharts  (Figure  G5),  rate  limiting  was  present 
in  this  example,  but  the  aircraft  and  pilot  were  still  in  phase.  The  evaluation  pilot  found  the 
handling  qu^ities  of  the  simulated  aircraft  favorable  and  assigned  a  PIO  tendency  rating  of  1. 
The  occurrences  of  PIO  tendency  ratings  of  4,  5,  and  6  given  for  this  example  were 
unexpected  and  did  not  match  theory.  Further  investigation  of  these  unexpected  ratings 
found  that  rate  limiting  was  present  for  all  three  evaluations,  but  the  pilot  and  the  aircraft 
were  still  in  phase.  These  unexpected  findings  led  to  the  issue  of  data  quality. 

Data  quality  of  points  where  LAMARS  results  did  not  fall  in  line  with  the  predicted 
Gap  Criterion  theory  were  questioned.  Specifically,  for  low  Gap  Criterion  values  where 
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PIO  was  predicted,  there  were  instances  where  favorable  PIO  tendency  ratings  (1-3)  were 
given  when  rate  limiting  occurred  and  the  aircraft  response  was  180  degrees  out  of  phase 
with  the  inputs  of  the  pilot  (classic  PIO).  Also,  there  were  examples  when  non-favorable 
PIO  tendency  ratings  (4-6)  were  assigned  for  high  Gap  Criterion  values  where  no  rate 
limiting  occurred  and  no  PIO  was  predicted.  It  was  concluded  that  the  occurrences  of 
favorable  PIO  ratings  given  when  “classic”  PIO  was  present  were  the  result  of  the  pilot 
failing  to  interpret  PIO  cues  correctly.  It  was  also  concluded  that  non-favorable  PIO  ratings 
given  without  the  presence  of  rate  limiting  were  attributable  to  some  other  phenomenon  other 
than  rate  limiting.  The  Gap  Criterion  was  not  extended  to  include  analysis  of  non  rate 
limited  PIO.  Therefore  from  this  analysis  the  data  were  screened  and  points  were  removed 
according  to  the  following  criteria: 

'  (1)  Cases  employing  a  15  deg/sec  rate  limit  where  rate  limiting  was  present  and  the 

aircraft  response  was  approximately  180  degrees  out  of  phase  with  the  pilot’s  inputs 
and  a  favorable  PIO  tendency  rating  was  assigned;  and 

(2)  Cases  employing  a  60  deg/sec  rate  limit  where  the  aircraft  and  pilot  were  in  or  out 
phase,  but  no  rate  limiting  occurred  and  a  non-favorable  PIO  tendency  rating  was 
assigned. 

Data  were  not  eliminated  from  the  30  deg/sec  rate  limit  cases  because  of  ambiguities 
in  determining  the  cause  of  a  possible  PIO  from  aircraft  dynamics  or  rate  limiting. 

New  correlation  factors  were  calculated  once  the  data  were  screened  and  are  shown  in 
Table  4.  In  total,  six  data  points  were  removed  from  the  Phase  2  Sum-of-Sines  task  and  two 
samples  were  removed  from  the  Phase  3  Discrete  HUD  tracking  task.  As  a  result  of  the  data 
screening  the  minimum  correlation  coefficient  values  for  80%  and  95%  confidence  increased 
due  to  the  reduction  in  sample  size  but,  the  computed  correlation  coefficients  for  the  linear 
models  also  increased  resulting  in  better  correlation.  Figures  in  Appendix  G  also  include  the 
screened  LAMARS  data  sets. 


Table  4:  Summary  of  Recalculated  LAMARS  Simulation  Results 


Phase  2 

Sum  of  Sines 

60 

0.168 

0.254 

0.581 

YES 

SATISFACTORY 

Phase  3 
Discrete 

47 

0.190 

0.288 

0.501 

YES 

SATISFACTORY 

Phase  3 

Target  Tracking 

44 

0.197 

0.297 

0.469 

YES 

SATISFACTORY 

The  values  for  Tmin  represent  the  minimum  required  value  of  the  correlation  coefficient  for  the  stated  level  of  confidence 


It  is  evident  that  a  correlation  exists  between  assigned  PIO  tendency  ratings  and  the 
associated  Gap  Criteria.  This  program  did  not  take  the  next  step  to  determine  the  amount  of 
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correlation  between  these  two  values.  Conduct  further  evaluations  to  determine  the  level 
of  correlation  between  PIO  tendency  ratings  and  Gap  Criterion  values.  (Rl)* 


Flight  data 

The  final  objective  was  to  determine  the  correlation  between  PIO  tendency  rating  and  Gap 
Criterion  using  the  NF-16  VISTA. 


Flight  test  procedures 

PIO  tendency  ratings  for  each  combination  of  bare  airframe  dynamics  and  actuator 
rate  limit  listed  in  Appendix  D  were  evaluated  using  a  sum-of-sines  tracking  task  during 
Phase  2  evaluation  and  either  a  discrete  tracking  task  or  target  tracking  evaluation  during 
Phase  3  evaluation.  These  tasks  were  performed  in  the  NF-16D  VISTA.  The  test  conditions 
were  15,000  ft  pressure  altitude  and  300  KIAS.  The  test  points  of  were  randomly  ordered 
and  the  test  pilot  was  unaware  of  the  configuration  being  flown.  Phase  1, 2  and  3  evaluations 
were  conducted  on  each  test  point.  Graphical  descriptions  of  the  sum-of-sines  and  discrete 
HUD  pitch-tracking  task  are  shown  in  Appendix  E.  The  gain  of  the  pitch  angle  MIL-HDBK- 
1797  pitch  tracking  task  was  increased  150%  to  increase  pilot  workload  and  bandwidth.  The 
aircraft  target-tracking  task  was  conducted  using  a  T-38  target  aircraft.  VISTA  flew 
approximately  2,000  ft  in  trail  of  the  target  and,  on  command,  the  target  aircraft  began  a  3g 
constant  airspeed  turn.  Altitude  was  used  to  maintain  g  and  airspeed  constant.  The  VISTA 
evaluation  pilot  delayed  and  then  attempted  a  gross  acquisition  capture  of  the  target. 

Multiple  capture  attempts  per  test  point  were  used  to  determine  PIO  tendency  rating. 


Flight  test  results 

The  recorded  PIO  tendency  ratings  for  each  task  were  plotted  against  the  corre¬ 
sponding  Gap  Criterion  values.  A  correlation  coefficient  was  computed  (Appendix  B)  to 
determine  if  a  correlation  exists  between  the  two  values.  Table  5  shows  a  summary  of  the 
LAMARS  simulation  results. 


Table  5:  Summary  of  flight  test  results 


Phase  2 
Sum-of-sines 

81 

0.144 

0.219 

0.301 

YES 

SATISAFACTORY 

Phase  3 
Discrete 

48 

0.188 

0.284 

0.327 

YES 

SATISAFACTORY 

27 

0.255 

0.331 

0.008 

NO 

UNSATISFACTORY 

The  values  for  represent  the  minimum  required  value  of  the  correlation  coefficient  for  the  stated  level  of  confidence 


*  Numerals  preceded  by  an  R  within  parentheses  at  the  end  of  a  paragraph  correspond  to  the  recommendation 
numbers  tabulated  in  the  Conclusions  and  Recommendations  section  of  this  report. 
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From  Table  5  it  can  be  stated,  with  95%  confidence  that  a  correlation  exists  between 
PIO  tendency  rating  and  the  corresponding  Gap  Criterion  values.  This  evaluation  was  true 
for  both  the  Phase  2  and  Phase  3  Discrete  tracking  task.  The  Phase  3  target  tracking  task 
showed  no  correlation. 

Figures  in  Appendix  H  show  the  PIO  tendency  rating  vs.  Gap  Criterion  raw  data  for 
each  task  completed  in  the  VISTA.  As  with  the  LAMARS  data,  there  were  numerous 
instances  where  identical  PIO  tendency  ratings  were  given  for  a  specific  Gap  Criterion  value. 
Looking  specifically  at  Figure  HI  A  and  HIB,  which  show  the  VISTA  data  for  a  Phase  2 
sum-of-sines  task,  there  are  several  data  points  that  support  the  Gap  Criterion  theory.  The 
first  example  of  such  is  a  data  point  with  a  small  Gap  Criterion  value.  For  this  data  point 
during  Phase  2  evaluations  there  were  eight  instances  where  test  pilots  assigned  a  PIO 
tendency  rating  of  4  or  5.  Looking  at  the  associated  stripcharts  for  one  of  these  instances, 
(Figure  H4)  the  aircraft’s  response  was  clearly  out  of  phase  with  pilot’s  inputs  with  rate 
limiting  present.  The  second  example  is  a  data  point  with  a  large  Gap  Criterion  value.  The 
six  PIO  tendency  ratings  assigned  for  this  Gap  Criterion  varied  from  1-3.  Looking  at  the 
associated  stripcharts  for  one  instance,  (Figure  H5)  rate  limiting  was  not  present,  but  there 
was  a  slight  amount  of  phase  lag.  Even  with  a  little  phase  lag,  the  evaluation  pilot  found  the 
handling  qualities  of  the  simulated  aircraft  favorable. 

As  with  the  LAMARS  data,  VISTA  flight  tests  generated  some  data  points  which  did 
not  fall  in  line  with  the  predicted  theory.  As  a  result  the  data  were  screened  and  points  were 
removed  according  to  the  same  criteria: 

(1)  Cases  employing  a  15  deg/sec  rate  limit  where  rate  limiting  was  present  and  the 
aircraft  response  was  approximately  180  degrees  out  of  phase  with  the  pilot’s  inputs 
and  a  favorable  PIO  tendency  rating  was  assigned;  and 

(2)  Cases  employing  a  60  deg/sec  rate  limit  where  the  aircraft  and  pilot  were  in  or  out 
phase,  but  no  rate  limiting  occurred  and  a  non-favorable  PIO  tendency  rating  was 
assigned. 

Data  were  not  eliminated  from  the  30  deg/sec  rate  limit  cases  because  of  ambiguities  in 
determining  the  cause  of  a  possible  PIO  from  aircraft  dynamics  or  rate  limiting. 

New  correlation  factors  were  calculated  once  the  data  were  screened  and  are  shown  in 
Table  6.  In  total,  ten  data  points  were  removed  from  the  Phase  2  Sum-of-Sines  task,  two 
samples  were  removed  from  the  Phase  3  Discrete  HUD  tracking  task  and  one  data  point  was 
removed  from  the  Phase  3  Target  tracking  task.  As  a  result  of  the  data  screening,  die 
minimum  correlation  coefficient  values  for  80%  and  95%  confidence  increased  due  to  the 
reduction  in  sample  size,  but  the  computed  correlation  coefficients  for  the  linear  models  also 
increased  resulting  in  better  correlation.  Figures  in  Appendix  H  also  show  the  screened 
VISTA  data  sets. 
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Table  6:  Summary  of  Recalculated  Flight  Test  Results 


Phase  2 
Sum  of  Sines 


Phase  3 
Discrete 


Phase  3 

Target  Tracking 


71 


46 


26 


0.154 


0.193 


0.260 


0.233 


0.291 


0.388 


0.400 


0.3308 


0.0945 


YES 


YES 


NO 


SATISFACTORY 


SATISFACTORY 


UNSATISFACTORY 


The  values  for  Tnun  represent  the  minimum  required  value  of  the  correlation  coeffieient  for  the  stated  level  of  confidence 


In  all  cases  of  flight  test,  the  Phase  3  Target  Tracking  task  yielded  the  worst  results  in 
terms  of  correlation.  This  poor  performance  was  attributed  to  two  major  factors:  (1)  The  low 
steady  state  turn  rate  and  lower  than  expected  maximum  load  factor  or  “g”  of  the  VISTA  at 
the  test  conditions  (15,000  ft  MSL,  300  KCAS)  and  (2)  the  repeatability  of  the  tracking  task. 
Depending  on  how  long  the  test  pilot  delayed  before  attempting  the  gross  acquisition 
determined  the  aircraft  response.  If  the  delay  was  short,  the  VISTA  was  still  “ramping-up” 
in  turn  rate  and  g  when  the  capture  was  attempted.  This  capture  usually  required  a  high-gain 
input  to  stop  the  turn  rate  at  the  desired  level.  If  the  delay  was  too  long,  the  VISTA  reached  a 
steady  state  turn  rate  and  g  which  made  the  capture  task  extremely  predictable  and  only 
required  the  pilot  to  make  low-gain  inputs  to  achieve  the  desired  rates.  In  retrospect,  the 
target  tracking  task  procedure  was  poorly  defined  and  the  conditions  chosen  were  not 
selected  to  elicit  the  desired,  high-gain  pilot  response.  See  Appendix  K  for  lessons  learned. 
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CONCLUSIONS  AND  RECOMMENDATIONS 

A  new  metric  called  the  Gap  Criterion  was  developed  and  compared  to  Pilot-induced 
Oscillation  (PIO)  tendency  ratings.  The  objective  of  this  program  was  to  evaluate  the  utility 
of  the  new  criterion  for  predicting  PIO  Tendency  Rating  for  rate-limited  actuators.  Gap 
Criterion  values  were  compared  to  assigned  PIO  tendency  ratings  from  four  sets  of  aircraft 
dynamics  at  three  different  elevator  rate  limits  using  historical  data,  the  Large  Amplitude 
Multimode  Aerospace  Simulator  (LAMARS)  and  the  NF-16D  Variable  In-flight  Simulator 
Test  Aircraft  (VISTA). 

The  results  of  historical  data,  LAMARS  data  and  VISTA  flight  data  positively 
demonstrated  that  there  was  a  correlation  between  the  Gap  Criterion  and  assigned  PIO 
tendency  rating.  In  general,  small  Gap  Criterion  values  corresponded  to  large  or  poor  PIO 
tendency  ratings  and  vice  versa.  This  program  established  that  there  was  a  correlation  but 
did  not  explore  the  significance  of  the  correlation. 

R1  Conduct  further  evaluations  to  determine  the  level  of  correlation 
between  PIO  tendency  ratings  and  Gap  Criterion  values.  (Page  9) 
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APPENDIX  A:  DERIVATION  OF  THE  GAP  CRITERION 


Theory 

This  appendix  will  discuss  describing  functions  and  how  they  can  be  used  to 
understand  and  predict  PIO  onset  when  considered  in  the  context  of  rate-limited  actuators. 
Further,  the  Neal-Smith  pilot  model  will  be  explained  followed  by  an  example  integrating  all 
of  these  concepts.  The  basis  of  the  Gap  Criterion  will  then  be  covered. 


Describing  Function  Development 

Observing  the  time  history  of  an  F-15E  PIO  from  Figure  A-1,  it  can  be  seen  that  the 
pilot  input  is  approximately  sinusoidal.  This  is  true  in  general  of  all  PIO  incidents 
(Reference  6).  The  describing  function  technique  can  be  used  for  limit  cycle  analysis  due  to 
the  fact  that  the  form  of  the  signals  in  a  limit-cycling  system,  such  as  a  PIO,  is  usually 
approximately  sinusoidal  (Reference  7). 


r-l5Ci  PITCH  CftS  OFT  PIO 

F-ISEl*«rT*M  IPI«1-7*lAHTIB«+<3  »TAH1CS 
Fit  la 
t.9n.^2aK 

INS  *  »EB 


K 


-^'xAAAA/' 


i. 


ritcH  tAit  *  Dte/scc 


»*.Sa 

nr 


I*-' '• 

wyvvv' 


4 


10M6n»liM4.  SIKK  F6MCC  •  tt 


I. 


11,  J*.  II,  f*.  II. 

Ii«f  -  ttt 


Figure  Al.  F-15E  PIO  Sequence  (Reference  6) 
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Any  system,  which  can  be  rearranged  into  the  form  shown  in  Figure  A-2,  can  be 
studied  using  describing  functions  (Reference  7).  Examples  of  nonlinear  elements  include 
dead-zones,  hysteresis  or  saturations.  Saturations  are  the  focus  of  this  study. 


Figure  A2.  Example  of  a  Nonlinear  System 


For  the  basic  version  of  the  describing  function  method,  the  system  has  to  satisfy  the 
following  four  conditions  (Reference  7): 


1)  There  is  only  a  single  nonlinear  component 

2)  The  nonlinear  component  is  time-invariant 

3)  Corresponding  to  a  sinusoidal  input  x  =  A  sin(cot),  only  the  fundamental 
component  W](t)  in  the  output  w(t)  has  to  be  considered 

4)  The  nonlinearity  is  odd 


Consider  a  sinusoidal  input  into  the  nonlinear  element  of  the  system  shown  in  Figure 
2-1  of  the  form  x(t)  =  A  sin(cot).  Due  to  nonlinear  effects,  the  output  w(0  is  often  a  periodic 
though  non-sinusoidal  function.  The  output  function  w(t)  can  be  expanded  using  Fourier 
series  as  seen  in  Eqn  1  and  the  derivation  which  follows  (Reference  7): 

w(t)  =  —  +£[«„  cos(nCDt)  +  b„  sin(ncot)  (Al) 


where: 


a 


0 


n 

—  J  'w{jt)d{ox) 

7t  -n 


(A2) 
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.=4 


7t  -n 


w(t)  cos(n  cot)d  (ax) 


(A3) 


7[ 


ij 


w(l)  sm(n0X)d  (oX) 


(A4) 


Applying  condition  four  from  above,  ao  =  0  for  all  odd  functions.  Further,  applying 
the  third  assumption  means  discarding  all  other  terms  except  n  =  1  (Reference  7).  This 
leaves: 


w(t)  ~  w^  (t)  =  Oj  cos(£or)  +  sin(ft») 
which  can  be  rewritten  as: 


Wj  (t)  =  M  sin(fiAf  + 


Where 


M  +bi^ 


^  =  tan 


-1 


(A5) 


(A6) 


(A7) 

(A8) 


Rewritten  in  complex  notation  leads  to: 


w,  (0  =  =  (fc,  +  ja,  (A9) 


Finally,  the  describing  function,  N(A,o}),  is  defined  to  be  the  complex  ratio  of  the 
fundamental  component  of  the  nonlinear  element  to  the  input  sinusoid.  ITiis  is  shown  in  Eqn 
9: 
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NiA,a))  = 


M 

A 


A 


(AlO) 


below: 


Now  consider  the  saturation  input-output  relationship  shown  in  Figure  A-3 


Figure  A3.  Saturation  Nonlinearity  and  the  Corresponding  Input-output  Relationship 


From  the  figure,  it  is  apparent  that  if  our  input,  x(t)=  A  sin(cot),  has  a  maximum 
amplitude  A<a  then  the  input  remains  in  the  linear  range  and  the  output  is  just  w(t)  = 
kAsm(cot).  But  if  the  maximum  amplitude.  A,  is  greater  than  a,  clipping  occurs  and  the  value 
of  w(t)  can  be  split  up  into  two  sets  over  the  first  quarter  of  the  symmetric  output: 


Q<cot<y 
y<(ot<  Till 


where  y  =  sin’*(a/A) 


The  output  w(t)  is  an  odd  function,  implying  ai  =  0  in  Eqn  5.  Further,  dividing  the 
output  into  four  quarters  yields  a  new  equation  for  bi. 
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"A 

4  f 

&,  =  — J  w(Osin(<yf)c?(<wf) 

7t  0 


(All) 


kAs\n^  {oX)d{(iot) 


-A 

4  f 

H — J  ka^m(fiX)difiX) 
7t  r 


(A12) 


(A13) 


Substituting  ai=0  and  Eqn  13  into  Eqn  10  leaves: 


(A14) 


NiA,co)=\  =  — 

A  n 


r+ 


a  f  ? 

aT'^' 


7t 


Sin 


-1 


a\  a  ,  a} 

ArAT^ 


Sinusoidal  Input  Describing  Function  Approximation 

Now,  consider  the  block  diagram  in  Figure  A-4  of  a  first  order  actuator  system  and 
the  derivations  which  follow  (Reference  6). 


Figure  A4  Actuator  Model  Development 
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The  nonlinear  portion  of  this  model  is  exactly  the  same  as  the  saturation  nonlinearity 
discussed  previously.  Substituting  the  appropriate  new  nomenclature  and  letting  e(t)  =  E 
sin(G)r  +  (p)  replace  x(t),  leads  to  the  following  describing  function  for  the  nonlinear  element: 


N{A,(0)  = 


(A15) 


Further,  by  using  series  expansions  for  both  the  arcsine  term  and  the  square  root  the 
describing  function  can  be  approximated  by: 


N{A,co)=^ 


71 


— +  — 

E  6 


2  E^ 


J 


(A16) 


Keeping  only  the  first  order  linear  terms  yields: 


N(A,a))  = 


TT  E  E 


TT  E 


(A17) 


Substituting  Vl  =  a>a  leads  to: 


4  V 

N{A,0))  =  —t 

7t  E 


(A18) 


Next,  consider  the  revised  block  diagram  shown  in  Figure  A-5  and  determine  the 
closed  loop  transfer  function,  treating  iV  as  a  constant. 
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Figure  A5.  Closed  Loop  Actuator  Transfer  Function  Diagram 


Treating  N  as  a  constant  and  utilizing  standard  block  diagram  transfer 
function  techniques,  the  relationship  of  e  to  becommand  is: 


e{s)  _  1 

S ^command  (5')  j  ^  ^  (A  1 9) 

s 

Assuming  Secommand(t)  =  A  sin((yO  and  e(t)  =  E  sin(co?  +  (p)  and  substituting  for  5', 
the  equation  for  the  magnitude  of  this  transfer  function  becomes: 


e(s) 

1 

E  sin(tyt  + 

S^command{s) 

/, 

,,  iH - -r 

Asin(<«r) 

£ 

A 


O)^ 


(A20) 


Rearranging  Eqn  18  in  terms  of  E  gives: 


4V, 

E  = - ^ 

n  N 


(A21) 


Substituting  Eqn  21  into  Eqn  20  and  rearranging  terms  yields: 
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(0 

^ 7t  AQ)^^ 

1(1 4 


(A22) 


Now,  still  treating  iV  as  a  constant  and  utilizing  standard  block  diagram  transfer 
function  techniques,  the  relationship  of  5e  to  Secommand  is: 


S,{s)  _  1  ^  N 

S ^command  (s)  ^  j  s  +  N 

N 


(A23) 


and  its  magnitude  is: 


command  ( j  co) 


+N'^ 


(A24) 


and  substituting  Eqn  22  into  Eqn  24  gives: 


sAm 

command  (jeo) 


7t  Act) 


(A25) 


Solving  for  the  phase  angle  of  Eqn  21  yields: 
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- ^.,['^'1 

S^command(jo))  \  N  J 


(A26) 


And  substituting  Eqn  20  yields: 


S^command{jci)) 


=  -tan 


-1 


4  V, 


t  y 


(A27) 


Sinusoidal  lnputn*riangle  Output  Describing  Function  Approximation 

Another  describing  function  approximation  can  be  made  by  utilizing  the  observed 
characteristics  of  a  saturated  actuator.  The  input,  Xi(t),  is  sinusoidal  in  nature  and  the  output, 
X(^t),  takes  on  the  familiar  saw  tooth  triangle  shape  as  shown  in  Fig  2-5: 


Figure  A6.  Rate  limiting  Input  and  Output 
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As  before,  let  the  input  be  sinusoidal  as  shown  in  Eqn  28: 


Xi(t)  =  Ximax  sin(cyO 


(A28) 


and  the  derivative  or  input  rate  is: 


X  i(t)  —  Xi  max  ^  COS(CDt) 


(A29) 


Now,  let  ©  =  In/T  where  T  =  4ti.  Then  the  maximum  input  rate  is: 


7t  X: 


max 


2  r, 


(A30) 


The  rate  of  the  output. 


xo ,  is  equal  to  the 


slope  of  the  output  and  is  given  by: 


^0 


(A31) 


Now,  take  the  relationship  of  the  output  rate  to  the  input  rate  in  the  range  of  to  and 
solve  for  the  ratio  of  output  to  input  magnitude  as: 


io _ _ 


Xi, 


2  t, 


_Xo 


2t. 


to 


(A32) 


Recognizing  to  equals  q,  and  rearranging  terms  gives: 
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^g_  _  5_^0_  _ 


Xi 


(A33) 


Rewriting  this  expression  in  terms  of  the  Figure  2-3  variables  and  recognizing  that  the 
output  rate  when  saturated  is  Vl  and  the  maximum  input  rate  is  Aco  leaves 


2  Aco 


(A34) 


The  describing  function  magnitude  is  then  expressed  using  the  K*  value  multiplied 
by  the  Fourier  fundamental  of  the  triangle  wave  as  seen  in  Eqn  35  (Reference  6). 


6jCommand(ia)) 


%  Aco 


(A35) 


This  is  exactly  the  same  expression  derived  earlier  for  the  closed  loop  actuator 
describing  function  magnitude.  To  obtain  the  phase  angle  of  the  input/output  relationship, 
the  term  to  as  shown  in  Figure  A-6  must  be  determined.  The  input  and  output  amplitudes  are 
equal  when  t  =  ti  +  tp.  Substituting  this  into  Eqn  26  yields: 


sin[cy(/,+to)]  =  Jfo 


(A36) 


Simplifying  this  expression  by  substituting  K*  =  X(/xi  max,  expanding  sin[co(r,-  +  tp)], 
and  substituting  cot,  =  ii/2  results  in  (Reference  6): 
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cos(/l<p)  =  K* 


(A37) 


Where  =  cot d  is  the  phase  angle  between  the  input  and  output.  Solving  for  A<p 
and  noting  that  it  is  a  phase  lag  leads  to  Eqn  38: 


-Af  =  -cos-\K*) 


S ^command  (  jO)) 


=  -tan 


-1 


(A38) 


Now  to  compare  with  the  closed  loop  describing  function  phase  angle,  substitute 
TT  V 

K*  = - ^into  Eqn  38  as  accomplished  in  Eqn  39: 

2  Aco 


Z  =-tan 

6gCommand(j<y) 


(A39) 


This  is  slightly  different  from  the  closed  loop  describing  function  phase  angle.  These 
differences  are  shown  in  Figure  A-7: 
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Figure  A7.  Describing  Function  Phase  Angle  Comparison 

The  more  accurate  of  these  two  describing  function  approximations  for  application  to 
Category  II PIO  is  the  sinusoidal  input/triangle  output  solution  (Reference  6). 


Applying  Describing  Function  Results  to  Predict  PiO 

Consider  the  longitudinal  closed  loop  system  shown  in  Figure  A-8.  Gp(s)  represents  a 
model  of  the  pilot  and  Gc(s)  represents  a  model  of  the  bare  airframe.  The  remaining  elements 
are  equivalent  to  the  rate  limited  actuator  model  previously  discussed  in  Figure  A-4. 


e 


Figure  A8.  Pitch  Tracking  Closed  Loop  System 


The  linear  elements  Gp  (s)  and  Gc(s)  can  be  combined  into  one  linear  element,  G(s) 
and  the  nonlinear  element,  N(A,o)),  remains  separate  as  shown  in  Figure  A-9, 


Figure  A9.  Simplified  Pitch  Tracking  Closed  Loop  System 


The  requirement  for  a  neutrally  damped  oscillation  is  simply  that  the  open-loop 
amplitude  ratio  equal  1.0  and  for  the  phase  to  be  -180°  (Reference  6).  In  order  for  a  PIO  to 
persist,  the  system  shown  in  Fig  A-9  must  satisfy  the  Nyquist  criteria  shown  in  the  following 
equation  (Reference  6): 


GUca)N(ja},A)  =  -l 


(A40a) 


or 


GUco)  = 


-1 

iV(MA) 


(A40b) 


The  easiest  way  to  view  the  application  of  this  equation  is  to  plot  the  open-loop 
magnitude  and  phase  values  of  the  negative  inverse  describing  function  (-l/Nijco,  A))  using 
the  K*  solutions  from  Eqns  35  and  37  as  well  as  the  open-loop  magnitude  and  phase  of 
G(jci>).  If  the  two  plots  intersect,  a  PIO  is  predicted  (Reference  6).  This  will  be  shown  by 
means  of  an  example  later  in  this  chapter.  The  K*  solutions  for  the  negative  inverse 
describing  function  are  shown  below  in  Eqns  41a  and  41b: 


-1 

N(K*) 


=  —20Log 


(dB) 


(A41a) 
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^ - ^—  =  —cos-\K*)-m  (deg) 

N{K*)  n 


(A41b) 


Pilot  Model 

There  are  many  pilot  models  to  choose  from  in  the  literature.  Some  believe  that  a 
simple  gain  with  no  phase  lag  best  represents  the  pilot  in  the  PIO  situation  (Reference  6). 
Others  believe  structural  models  are  better  predictors  (Reference  8).  In  another  recent  study, 
the  Neal-Smith  pilot  model  was  judged  to  best  represent  the  pilot  model  prior  to  the  onset  of 
rate  limiting  (Reference  9).  In  this  study,  the  Neal-Smith  pilot  model  will  be  utilized. 


The  Neal-Smith  pilot  model  is  useful  for  pilot-aircraft  pitch  attitude  control  loops 
with  unity-feedback  and  has  the  following  characteristics  (Reference  3): 


1.  Adjustable  Gain 

2.  Time  delay 

3.  Ability  to  develop  lead,  or  to  operate  on  derivative  or  rate  information 

4.  Ability  to  develop  lag,  or  to  smooth  inputs 

5.  Ability  to  provide  low-frequency  integration 

The  Neal-Smith  pilot  model  can  take  on  one  of  two  forms.  This  determination  is 
based  on  the  whether  constant  speed  or  two-degree-of-freedom  equations  are  used  to 
represent  the  bare  aircraft  dynamics.  These  are  typified  by  noting  whether  or  not  a  free 
integrator  is  contained  in  the  denominator  of  the  aircraft  pitch  transfer  function.  Otherwise, 
three-degree-of-freedom  equations  or  flight  control  system  utilizing  attitude  stabilization  will 
require  a  different  form.  The  following  table  shows  the  transfer  functions  of  the  Neal-Smith 
pilot  models  (Reference  3): 


Table  Al:  Neal-Smith  Pilot  Models 


Aircraft  Transfer  Function 

with  a  Free  Integrator 

Aircraft  Transfer  Function 

without  a  Free  Integrator 

‘’(Tp^s  +  l) 

(5s  +  l)(T„s  +  l)  0.25s 
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The  theory  states  that  the  pilot  chooses  his  gain,  Kp,  and  his  lead/lag  time  constants, 
Tpi  and  Tp2,  to  attain  a  certain  bandwidth.  This  bandwidth  varies  with  the  flight  phase 
category.  For  example,  for  Category  A  flight  phases  such  as  air-to-air  dogfighting,  the 
required  bandwidth  is  3.5  rad/sec.  This  is  measured  at  a  closed-loop  phase  of -90  degrees. 
Further,  the  pilot  adjusts  to  minimize  droop:  no  greater  than  3  dB  for  Level  1  performance 
and  no  greater  than  9  dB  for  Level  2  over  the  frequency  range  from  0  to  10  rad/sec  while  at 
the  same  time  minimizing  closed  loop  resonance  (Reference  3).  The  phase  lag  term,  e  ' 
represents  delays  in  the  pilot’s  neuromuscular  system  (Reference  3). 


Gap  Criterion 

Utilizing  the  previous  theoretical  developments,  a  systematic  process  relating  bare 
aircraft  plant  dynamics,  augmented  aircraft  plant  dynamics  and  actuator  rate  limits  to 
predicted  PIO  tendency  rating  will  be  introduced.  The  procedure  is  to  be  called  the  Gap 
Criterion. 

Computing  the  Gap  Criterion  consists  of  the  following  steps: 

1 .  Determine  the  bare  aircraft  pitch-to-commanded  actuator  transfer  function, 
Gc(s)  =  e(s)/5e(s) 

2.  If  the  short  period  poles  of  Gc(s)  are  unstable  then  Gap  Criterion  =  0.  This  is 
due  to  control  amplitudes  approaching  zero  causing  an  immediate  departure 
due  to  dynamic  instability. 

3.  Determine  an  appropriate  optimized  Neal-Smith  pilot  model,  Gp(s),  for  the 
bare  aircraft  transfer  function  Gc(s)  appended  with  the  first  order  linear 
actuator  model  Gact  shown  below  and  then  augmented  with  feedback. 

Gact  (s)  =  .  where  Wa  =  20 

S  +  G)a 

4.  Plot  the  open-loop  magnitude  and  phase  of  G(s)  =  Gc  (s)Gp  (s)  on  a  Nichols 
chart 

5.  Plot  the  negative  inverse  describing  function  open-loop  magnitude  and  phase 
on  the  same  Nichols  chart  using  the  K*  equations  A-41 A  and  A-41B 

6.  Determine  the  resulting  case  by  reference  to  Figure  A-10  and  then  compute 
the  Gap  Criterion  by  following  the  steps  of  that  case. 


Figure  A 10.  Resulting  Cases 
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Case  I 

1.  Determine  the  minimum  amount  by  which  the  pilot  would  need  to  increase  his 
gain,  AKp  (dB),  such  that  the  two  magnitude-phase  lines  just  intersect  at  a 
frequency  greater  than  the  -3  dB  Neal-Smith  droop  frequency 

2.  Determine  the  values  of  K*  and  co  (rad/sec)  at  this  intersection 

3.  Determine  the  amplitude,  A,  of  the  commanded  actuator  deflection  utilizing 
the  following  equation  where  Vl  is  the  known  actuator  rate  limit  in  deg/sec: 

2  Aco 

4.  Normalize  this  amplitude  by  dividing  by  the  maximum  available  actuator 
deflection,  Amax 

5.  The  Gap  Criterion  is  this  normalized  amplitude  multiplied  by  AKp. 

Gap  Criterion  = 

Case  II 

1 .  Determine  the  minimum  amount  by  which  the  pilot  would  need  to  decrease 
his  gain,  AKp  (dB),  such  that  the  two  magnitude-phase  lines  only  intersect  in 
one  place  at  a  frequency  greater  than  the  -3  dB  Neal-Smith  droop  frequency 

2.  Determine  the  values  of  K*  and  cd  (rad/sec)  at  this  intersection 

3.  Determine  the  amplitude.  A,  of  the  commanded  actuator  deflection  utilizing 
the  following  equation  where  Vi  is  the  known  actuator  rate  limit  in  deg/sec; 

2  Aco 

4.  Normalize  this  amplitude  by  dividing  by  the  maximum  available  actuator 
deflection,  Amax 

5.  The  Gap  Criterion  is  this  normalized  amplitude  multiplied  by  AKp. 

Gap  Criterion  =  (A/A„^)*I0^'^’^p'^'^^ 

Case  in 

1.  Determine  the  values  of  K*  and  co  (rad/see)  at  the  intersection 

2.  Determine  the  amplitude.  A,  of  the  commanded  actuator  deflection  utilizing 
the  following  equation  where  Vl  is  the  known  actuator  rate  limit  in  deg/sec: 

2  Aco 

3.  Normalize  this  amplitude  by  dividing  by  the  maximum  available  actuator 
deflection,  Amax 

4.  The  Gap  Criterion  is  this  normalized  amplitude  multiplied  by  AKp. 

Gap  Criterion  -  (A/Amax) 

Case  rv 

1.  No  determination  of  Gap  Criterion  can  be  made,  deg/sec: 
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Example  of  Gap  Criterion  Application 

Reconsider  the  closed  loop  system  of  Figure  A-8  with  the  following  characteristics: 


G,(s) 


(4.5)(s  +  1.5) 
s(s^  +  3s  +  6) 


Gac.(s) 


20 

s  +  20 


•  Vl  =  30  deg/sec 


•  Maximum  actuator  deflection:  5e  max  =  30  deg 


•  Category  A  flight  phase 


Utilizing  the  USAF  Wright  Laboratory  Flight  Dynamics  Directorate’s  MATLAB® 
Interactive  Flying  Qualities  Toolbox  for  Matlab  (Reference  10),  the  Neal-Smith  pilot  model 
was  found  to  be: 


Gp  (s)  =  0.856(0.583s  +  De^^^' 


Noting  that  this  is  an  improper  transfer  function  and  cannot  be  used  with 
MATLAB®,  the  model  was  modified  with  a  very  small  Tpa: 


Gp(s)  =  0.856 


(0.583s +  1) 

(0.0001s +  1) 


e-0.2Ss 


The  open-loop  magnitude  and  phase  of  G(s)  =  Gp(s)Gc(s)  are  plotted  in  Figure  A-1 1 
as  well  as  the  open-loop  magnitude  and  phase  of  the  negative  inverse  describing  function. 
This  is  a  Case  I  result.  It  can  be  seen  that  a  AKp  increase  of  7.502  dB  or  2.372  absolute  is  all 
that  is  needed  for  the  two  lines  to  meet.  At  this  intersection,  the  values  for  K*  and  co  are 
0.7635  and  3.9418  rad/sec,  respectively.  After  calculating  the  amplitude,  A  =  15.66  deg,  the 
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result  is  normalized  by  dividing  by  30  deg  (6emax)-  This  normalized  result  is  multiplied  by 
AKp  to  yield  the  Gap  Criterion.  In  this  example  the  Gap  Criterion  equals  1.238. 


Nichols  Chart 


Figure  All.  Nichols  Chart  of  the  Example  Problem 
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APPENDIX  B:  DATA  ANALYSIS 


OVERVIEW 

This  data  analysis  plan  (DAP)  appendix  describes  the  test  data  that  was  required  to  meet  the 
stated  objectives  and  the  associated  data  reduction  techniques.  The  majority  of  the  data 
collected  was  in  the  form  of  pilot  assigned  PIO  tendency  ratings  and  comments.  Time 
history  data  was  also  collected  as  supporting  data  (to  determine  the  presence  of  rate  limiting, 
evaluate  data  quality,  etc). 

REQUIRED  DATA 

The  following  data  from  each  test  point  were  required  for  analysis: 

•  Pilot  assigned  PIO  Rating 

•  Pilot  Comments 

•  Time  history  of  flight  data 

The  test  team  used  three  sources  of  data:  digital  data  from  the  VISTA  Data  Acquisition 
System  (DAS)  in  Matlab®  format  recorded  electronically,  pilot  audio  and  HUD  video 
recorded  on  HI-8  tapes,  and  data  recorded  in  the  control  room  and  in  the  test  aircraft. 

MEDIA  AND  DATA  FORMAT 

Table  B.l:  MAX  GAP  Test  Data,  identifies  the  time  history  data  sources,  the  data  media,  and 
the  format  in  which  the  data  were  recorded.  These  parameters  will  be  recorded  via  the  NF- 
16D  VISTA  data  acquisition  system.  The  data  was  converted  to  Matlab®  format  by 
Advanced  Information  Engineering  Services,  Inc. 


Table  Bl:  MAX  GAP  Test  Data 


Config 

None 

n/a 

1  to  999 

IIII^E!!SS^^S!!!^lil 

Eteg/sec 

64  Hz 

-80  to  80 

Degrees 

64  Hz 

-80  to  80 

Pilot 

Degrees 

64  Hz 

-40  to  40 

©task 

Degrees 

64  Hz 

-30  to  30 

ead 

Degrees 

64  Hz 

-30  to  30 

Vc 

KIAS 

64  Hz 

Oto  500 

N. 

G’s 

64  Hz 

-4  to  8 

Mach 

None 

64  Hz 

Otol 

Hi 

Ft 

64  Hz 

2000  to  22000 

Rec  No 

None 

64  Hz 

1  to  100 

None 

64  Hz 

Oorl 

Percent 

64  Hz 

Percent 

64  Hz 

Oto  100 

Total  Fuel 

Lbs 

64  Hz 

0  to  8000 

Rate  Flag 

64  Hz 

Otol 

38 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDUM 


DATA  REDUCTION 

Time  histories  of  flight  data  were  reduced  to  Matlab®  format  by  Advanced 
Information  Engineering  Services,  Inc.  after  each  flight  and  were  provided  electronically  to 
the  test  team.  HUD  Hi-8  video,  MFD  video,  pilot  audio,  written  pilot  comments  and  ratings, 
and  time  histories  were  used  to  review  each  test  point  to  determine  data  quality. 

DATA  ANALYSIS 

Test  Objective  2:  Determine  the  correlation  between  PIO  tendency  rating  and 
Gap  Criterion  using  the  LAMARS  simulator. 

'  PIO  Tendency  Ratings  were  collected  for  selected  bare  airframe  dynamics  and  rate 

limit  combinations  using  the  LAMARS  simulator. 

Data  Requirements 

•  PIO  Tendency  Rating 

•  Pilot  Comments 

•  MAX  GAP  Test  Data  time  histories 

Data  Reduction  and  Analysis 

The  pre-computed  Gap  Criterion  for  the  selected  bare  airframe  and  rate  limit 
configuration  was  plotted  versus  the  assigned  PIO  Tendency  Rating.  Pilot  comments  and 
MAX  GAP  test  data  were  used  to  determine  data  quality  and  the  presence  of  rate  limiting. 
The  significance  of  the  data  correlation  was  determined  by  computing  a  correlation 
coefficient,  r,  shown  in  equation  B1  (Reference  11). 


^(x,-xXy,-y) 
_ _ 

^  1-1  i-i 


(Bl) 


Where  n  is  the  number  of  data  pairs  and  x  and  y  are  the  mean  values 
of  X  and  y  which  were  obtained  experimentally  (Eqn  B2). 


(B2) 
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Test  Objective  3:  Determine  the  correlation  between  PiO  tendency  rating  and 
Gap  Criterion  using  the  NF-16  VISTA. 

PIO  Tendency  Ratings  were  collected  for  the  selected  bare  airframe  dynamics  and 
rate  limit  combinations  using  the  NF-16  VISTA 

Data  Requirements 

•  PIO  Tendency  Rating 

•  Pilot  Comments 

•  MAX  GAP  Test  Data  time  histories 

Data  Reduction  and  Analysis 

The  pre-computed  Gap  Criterion  for  the  selected  bare  airframe  and  rate  limit 
configuration  was  plotted  versus  the  assigned  PIO  Tendency  Rating.  Pilot  comments  and 
MAX  GAP  test  data  were  used  to  determine  data  quality  and  the  presence  of  rate  limiting. 
The  significance  of  the  data  correlation  was  determined  by  computing  a  correlation 
coefficient  as  shown  in  equation  B1  (Reference  1 1).  . 

DATA  ANALYSIS  PRODUCTS 

The  Quick  Look  and  In-Depth  analysis  were  used  to  generate  the  final  data  products. 
The  ultimate  product  was  a  plot  of  Gap  Criterion  versus  PIO  tendency  rating.  Supporting 
data  were  presented  in  the  form  of  time  history  plots  of  MAX  GAP  test  datasets. 

HARDWARE  AND  SOFTWARE  REQUIREMENTS 

Advanced  Information  Engineering  Services,  Inc.  provided  their  own  hardware  and 
software  to  reduce  the  VISTA  DAS  data  from  the  instrumentation  format  on  the  aircraft  to 
the  digital  Matlab®  format.  Desktop  PC  computers  with  Microsoft  Excel,  Matlab®  and 
Simulink®  were  available  at  TPS  to  perform  the  data  analysis.  Hi-8  tape  playback  equipment 
was  available  at  TPS  for  mission  review. 
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APPENDIX  C:  PIO  RATING  SCALES 


PIO  RATING  SCALE 

Did  I  experience  a  PIO? 

No 

Did  I  experience  undesirable  motion? 
. No 

1 

Yes 

Did  undesirable  motion  tend  to  occur? 

2 

Was  undesirable  motion  easily  induced? 

3 

Yes 

While  attempting  maneuvers  or  tight  control? 

Was  the  PIO  boundedl . 4 

Was  the  PIO  divergent! . 5 

While  exercising  normal  control? . 6 

DESCRIPTION 

NUMERICAL 

RATING 

No  tendency  for  pilot  to  induce  undesirable  motions. 

1 

Undesirable  motions  end  to  occur  when  pilot  Initiates  abrupt  maneuvers  or  attempts 
tight  ointrol.  These  motions  can  be  prevented  or  eliminated  by  pilot  technique. 

2 

Undesirable  motions  easily  induced  when  pilot  initiates  abrupt  maneuvers  or  attempts 
tight  ointrol.  These  motions  can  be  prevented  or  eliminated  but  only  at  sacrifice  to  task 
performance  or  through  considerable  pilot  attention  and  effort. 

3 

Oscillations  tend  to  develop  when  pilot  initiates  abrupt  maneuvers  or  attempts  tight  con¬ 
trol.  Pilot  must  reduce  gain  or  abandon  task  to  recover. 

4 

Divergent  oscillations  tend  to  develop  when  pilot  initiates  abrupt  maneuvers  or  attempts 
tight  control.  Pilot  must  open  loop  by  relasing  or  freezing  the  stick. 

5 

Disturbance  or  normal  pilot  amtrol  may  cause  divergent  oscillation.  Pilot  must  open 
confrol  loop  by  releasing  or  freezing  the  stick. 

6 

Figure  Cl:  Pilot-Induced  Oscillation  (PIO)  Rating  Scales 
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Figure  C2:  PIO  Tendency  Classification  Scale 
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APPENDIX  D;  TEST  POINT  CONFIGURATIONS 

Table  D1  shows  the  system  dynamics  used  for  the  Project  HAVE  PREVENT 
historical  evaluation.  The  corresponding  angle-of-attack  (Ka)  and  pitch-rate  (Kq)  feedback 
gains  used  for  the  Gap  Criterion  analysis  are  included. 


Table  Dl;  HAVE  PREVENT  Bare  Airframe  Test  Cases 


l.'Case-v' 

faDurox.}  ’ 

?  faDiirox.)  7  ^ 

A 

3.12 

0.70 

0 

0 

-2.18±-2.23j 

-.017±.074i 

B 

2.34 

0.61 

0.21 

0.14 

-2.27±2.35j 

-.017±.074i 

C 

0.86 

0.995 

0.51 

0.24 

-2.24±2.52j 
-.017  ±.074i 

D 

1.07,-1.67 

-.017±.033i 

72  =  2.31  sec 

0.61 

0.34 

-2.32±2.62j 

-.017±.074i 

Note:  Kq  and  K„  are  the  feedback  gains  required  to  achieve  the  desired  closed  loop  dynamics. 


These  test  cases  yielded  the  Gap  Criterion  values  shown  in  Table  D2,  based  on  a  maximum 
elevator  deflection  angle  of  ±30  degrees. 


Table  D2:  HAVE  PREVENT  Test  Case  Gap  Criterion  Values 


Bare  'Aiifeiiieli 

i^p 

A 

157sec 

0.555 

C 

157sec 

0.300 

A 

30°/sec 

1.109 

C 

30°/sec 

0.600 

A 

457sec 

1.664 

C 

457sec 

0.900 

A 

607sec 

2.218 

c 

607sec 

1.201 

B 

15®/sec 

0.556 

D 

157sec 

0 

B 

30°/sec 

1.111 

D 

307sec 

0 

B 

45°/sec 

1.667 

D 

457sec 

0 

B 

607sec 

2.223 

D 

607sec 

0 

Table  D3  shows  the  system  dynamics  used  for  the  Project  HAVE  OLOP  historical 
evaluation.  The  corresponding  angle-of-attack  (Ka)  and  pitch-rate  (Kq)  feedback  gains  used 
for  the  Gap  Criterion  analysis  are  included. 
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Table  D3:  HAVE  OLOP  Bare  Airframe  Test  Cases 


^ • ' 

A 

-.510±3.36j 

-.017±.074j 

3.40 

0.15 

0.023 

0.412 

-3.51±-3.58j 

-.017±.060j 

C 

2.15 

0.60 

0.897 

0.347 

-3.50±3.57j 

-.017±.074j 

D 

1.284,  -2.13 
-.017±.074j 

T2  =  0.6sec 

1.218 

0.487 

-3.55±3.62j 
-.017  ±.074j 

Note:  Kq  and  Kq  are  the  feedback  gains  required  to  achieve  the  desired  closed  loop  dynamics. 


These  test  cases  yielded  the  Gap  Criterion  values  shown  in  Table  D4,  based  on  a  maximum 
elevator  deflection  angle  of  ±30  degrees. 


Table  D4:  HAVE  OLOP  Test  Case  Gap  Criterion  Values 


I;  BareAirfraiine;>| 

‘  M^munjiv  I, ;; . 

^Eievator^tf  i 
^  '  D^flectibnT^ate 

Criterion,  , 

Bare  Airframe 

f''DeflectlbaRa'i»i 

A 

107sec 

0.049 

c 

407sec 

0.681 

A 

207sec 

0.097 

c 

507sec 

0.851 

A 

307sec 

0.146 

C 

607sec 

1.021 

A 

407sec 

0.194 

D 

107sec 

0 

A 

507sec 

0.243 

D 

207sec 

0 

A 

607sec 

0.291 

D 

307sec 

0 

C 

107sec 

0.170 

D 

40°/sec 

0 

C 

207sec 

0.340 

D 

507sec 

0 

C 

307sec 

0.510 

D 

607sec 

0 

Table  D5  shows  the  system  dynamics  used  for  the  MAX  GAP  LAMARS  evaluation. 
The  corresponding  angle-of-attack  (Ka)  and  pitch-rate  (Kq)  feedback  gains  used  for  the  Gap 
Criterion  analysis  and  the  LAMARS  programming  are  included. 


Table  D5:  MAX  GAP  LAMARS  Bare  Airframe  Test  Cases 


B 

-1.43±1.85j 

-.017±.074j 

2.34 

0.61 

0.156 

0.123 

-2.17±-2.22j 

-.017±.070j 

N 

3.13 

0.30 

-0.335 

0.177 

-2.18±2.22j 

-.018±.050j 

W 

4.71 

0.90 

-0.501 

-0.345 

-2.18±2.24j 

-.017±.081j 

B. 

2.32 

0.90 

0.346 

0.0334 

-2.19±2.24j 

-.017±.080j 

Note:  Kq  and  Ko  are  the  feedback  gains  required  to  achieve  the  desired  closed  loop  dynamics. 


These  test  cases  yielded  the  Gap  Criterion  values  shown  in  Table  D6,  based  on  a  maximum 
elevator  deflection  angle  of  ±30  degrees. 
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Table  D6:  MAX  GAP  LAMARS  Test  Case  Gap  Criterion  Values 


Table  D7  shows  the  actual  system  dynamics  used  for  MAX  GAP  VISTA  flight  test 
evaluation.  The  corresponding  angle-of-attack  (Ka)  and  pitch-rate  (Kq)  feedback  gains  used 
for  the  Gap  Criterion  analysis  are  included. 


Table  D7:  MAX  GAP  VISTA  Bare  Airframe  Test  Cases 


Note:  Kq  and  Ka  are  the  feedback  gains  required  to  achieve  the  desired  closed  loop  dynamics. 


These  test  cases  yielded  the  Gap  Criterion  values  shown  in  Table  D8,  based  on  a  maximum 
elevator  deflection  angle  of  ±30  degrees. 


Table  D8;  MAX  GAP  VISTA  Test  Case  Gap  Criterion  Values 
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Table  D9:  Test  ConOguration  Matrix 


,  Bare^duriraiDe; 

Msmimim  Elector  f 
‘  '  RateEiniit 

1 

B 

60 

Phase  2,  Sum-of-sines 

2 

B 

60 

Phase  3,  Discrete  Tracking 

3 

B 

60 

Phase  3,  Target  Tracking 

4 

B 

30 

Phase  2,  Sum-of-sines 

5 

B 

30 

Phase  3,  Discrete  Tracking 

6 

B 

30 

Phase  3,  Target  Tracking 

7 

B 

15 

Phase  2y  Sum-of-sines 

8 

B 

15 

Phase  3,  Discrete  Tracking 

9 

B 

15 

Phase  3,  Target  Tracking 

10 

N 

60 

Phase  2,  Sum-of-sines 

11 

N 

60 

Phase  3,  Discrete  Tracking 

12 

N 

60 

Phase  3,  Target  Tracking 

13 

N 

30 

Phase  2,  Sum-of-sines 

14 

N 

30 

Phase  3,  Discrete  Tracking 

15 

N 

30 

Phase  3,  Target  Tracking 

16 

N 

15 

Phase  2f  Sum-of-sines 

17 

N 

15 

Phase  3,  Discrete  Tracking 

18 

N 

15 

Phase  3,  Target  Tracking 

19 

W 

60 

Phase  2,  Sum-of-sines 

20 

W 

60 

Phase  3,  Discrete  Tracking 

21 

w 

60 

Phase  3,  Target  Tracking 

22 

w 

30 

Phase  2f  Sum-of-sines 

23 

w 

30 

Phase  3,  Discrete  Tracking 

24 

w 

30 

Phase  3,  Target  Tracking 

25 

w 

15 

Phase  2f  Sum-of-sines 

26 

w 

15 

Phase  3,  Discrete  Tracking 

27 

B 

60 

Phase  2f  Sum-of-sines 

28 

Y 

60 

Phase  2,  Sum-of-sines 

29 

Y 

60 

Phase  3,  Discrete  Tracking 

30 

Y 

60 

Phase  3,  Target  Tracking 

31 

Y 

30 

Phase  2f  Sum-of-sines 

32 

Y 

30 

Phase  3,  Discrete  Tracking 

33 

Y 

30 

Phase  3,  Target  Tracking 

34 

Y 

15 

Phase  2y  Sum-of-sines 

35 

Y 

15 

Phase  3,  Discrete  Tracking 

36 

Y 

15 

Phase  3,  Target  Tracking 

Notes: 

1.  All  test  points  will  be  flown  at  15,000  ft  pressure  altitude  and  300  KIAS.  The 
data  bands  are  ±5000  ft  and  ±10  KIAS  for  entry. 

2.  The  VSS  automatically  adjusts  for  fuel  weight.  The  VSS  gains  are  changed  to 
preserve  the  same  short  period  dynamics.  Aircraft  total  weight  does  not  have 
a  data  band. 
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APPENDIX  E:  TRACKING  TASKS 


Figure  El  Example  Heads  Up  Display 


Sum  of  Sines  Pitch  Tracking  Task 


Figure  E2:  Sum-of-sines  Pitch  Tracking  Task 


30 
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APPENDIX  F:  HISTORICAL  DATA  FIGURES 

The  MAX  GAP  historical  data  figures  are  in  this  appendix.  Data  from  two  previous 
Test  Management  Projects  (TMPs),  HAVE  PREVENT  and  HAVE  OLOP,  were  investigated 
to  see  if  a  correlation  between  PIO  tendency  rating  and  the  Gap  Criterion  existed.  There  are 
two  types  of  charts  shown.  One  is  a  2D  “bubble  chart”  of  the  PIO  tendency  rating  versus  the 
Gap  Criterion.  This  “bubble  chart”  uses  circles  of  different  diameters  to  depict  data  density 
in  terms  of  the  number  of  times  a  similar  PIO  tendency  rating  is  assigned  to  a  single  Gap 
Criterion  value.  Also,  a  linear  curve  fit  with  the  corresponding  equation,  value,  and 
correlation  factor  are  shown  on  the  2D  “bubble  chart.”  The  second  type  of  figure  is  a  3D 
stem  plot  with  the  same  data  as  the  2D  “bubble  chart”  from  a  different  perspective.  The 
horizontal  plane  of  the  3D  chart  contains  the  PIO  tendency  rating  and  the  Gap  Criterion. 

The  vertical  axis  shows  the  number  of  occurrences  for  a  single  PIO  tendency  rating  for  a 
discrete  Gap  Criterion.  An  increasing  height  of  the  vertical  bars  corresponds  to  a  greater 
number  of  occurrences.  The  same  linear  model  from  the  2D  “bubble  chart”  is  shown  on  the 
floor  of  the  3D  view.  This  provides  insight  into  how  the  data  density  drives  to  the  model  to 
match  the  Gap  Criterion  theory,  which  states  that  low  Gap  values  should  lead  to  the  high  PIO 
tendency  ratings  and  vice  versa 


Number  of  Occurrences  3  Tendency  Rating 
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HAVE  PREVENT  LAMARS  Phase  2  Sum-of-Sines  Task 


OX)  0,4  0.8  1,2  1.S  2.0  2.4 

Gap  Criterion 


FI  A:  HAVE  PREVENT  Phase  2  Sum-of-Sines  Task  LAMARS  Data  (2D) 


HAVE  PREVENT  LAMARS  Data  Phase  2  Sum-of-Sines 


PIO  Tendency  Rating  ^  °  Gap  Criterion 


Figure  FIB:  HAVE  PREVENT  Phase  2  Sum-of-Sines  Task  LAMARS  Data  (3D) 


Number  of  occurrences  >  PIO  Tendency  Rating 
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HAVE  PREVENT  LAMARS  Phase  3  Discrete  HUD  Pitch  Tracking  Task 


Q  Single  Data  Point 
Q  two  Data  Points 


— Linear  Fit 


Data  Basis:  15K  ft  PA.  300  KIAS 
Test  A/D  LAMARS  Simulation 
Acqujsllfon  Sytkem:  Hand  Held 
Configuration:  Cnil^ 

Test  Dates:  25-26  September  2002 


:  HAVE  PREVENT  Phase  3  Discrete  HUD  Tracking  Task  LAMARS  Data  (2D) 


HAVE  PREVENT  LAMARS  Data  Phase  3  HUD  Discrete  Task 


Figure  F2B:  HAVE  PREVENT  Phase  3  Discrete  HUD  Tracking  Task  LAMARS  Data  (3D) 
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HAVE  PREVENTLAMARS  Phase  3  Target  Task 


O  Single  Data  Point 
Q  Two  Data  Points 


— Linear  Fit 


Data  Basis  15K  ft  PA,  300  KtAS 
Test  A/O  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration;  Cruise 
Test  Dates:  25-26  Septemlier-2002 


Figure  F3A:  HAVE  PREVENT  Phase  3  Target  Task  LAMARS  Data  (2D) 


HAVE  PREVENT  LAMARS  Data  Phase  3  Target  Task 


Figure  F3B:  HAVE  PREVENT  Phase  3  Target  Task  LAMARS  Data  (3D) 
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HAVE  OLOP  VISTA  Phase  2  Sum-of-Sines  Task 


Figure  F4A:  HAVE  OLOP  Phase  2  Sum-of-Sines  Task  Flight  Data  (2D) 


HAVE  OLOP  FLIGHT  Data  Phase  2  Sum-of-Sines 


Figure  F4B:  HAVE  OLOP  Phase  2  Sum-of-Sines  Task  Right  Data  (3D) 


54 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDUM 


HAVE  OLOP  VISTA  Phase  3  Discrete  HUD  Pitch  Tracking  Task 


Figure  F5A:  HAVE  OLOP  Phase  3  Discrete  HUD  Tracking  Task  Flight  Data  (2D) 


HAVE  OLOP  FLIGHT  Data  Phase  3  HUD  Discrete  Task 


Figure  F5B:  HAVE  OLOP  Phase  3  Discrete  HUD  Tracking  Task  Hight  Data  (3D) 
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APPENDIX  G:  LAMARS  DATA  FIGURES 

The  MAX  GAP  LAMARS  test  data  figures  are  in  this  appendix.  There  are  three 
types  of  charts  shown.  One  is  a  2D  “bubble  chart”  of  the  PIO  tendency  rating  versus  the  Gap 
Criterion.  This  “bubble  chart”  uses  circles  of  different  diameters  to  depict  data  density  in 
terms  of  the  number  of  times  a  similar  PIO  tendency  rating  is  assigned  to  a  single  Gap 
Criterion  value.  Also,  a  linear  curve  fit  with  the  corresponding  equation,  value,  and 
correlation  factor  are  shown  on  the  2D  “bubble  chart.”  The  second  type  of  figure  is  a  3D 
stem  plot  with  the  same  data  as  the  2D  “bubble  chart”  from  a  different  perspective.  The 
horizontal  plane  of  the  3D  chart  contains  the  PIO  tendency  rating  and  the  Gap  Criterion. 

The  vertical  axis  shows  the  number  of  occurrences  for  a  single  PIO  tendency  rating  for  a 
discrete  Gap  Criterion.  An  increasing  height  of  the  vertical  bars  corresponds  to  a  greater 
number  of  occurrences.  The  same  linear  model  from  the  2D  “bubble  chart”  is  shown  on  the 
floor  of  the  3D  view.  This  provides  insight  into  how  the  data  density  drives  to  the  model  to 
match  the  Gap  Criterion  theory,  which  states  that  low  Gap  values  should  lead  to  the  high  PIO 
tendency  ratings  and  vice  versa.  The  third  chart  shown  contains  stripchart  time  histories  of 
the  following:  LAMARS  longitudinal  stick  position;  variation  of  pitch  angle  and  HUD  task 
pitch  angle;  variation  of  alpha;  left  and  right  elevator  position;  and  actual  actuator  rate. 


Number  of  Occurrences 
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LAMARS  Data  Phase  2  Sum-of-Sines 


O) 

c 

OC  4 

S' 

g 
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c 

fi  3 

O 

£ 
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O 

OOO®  o  o 

o 

0>  O 

y» -0.6387X  + 4.461 
R*«0.1135 
|R|  -  0.3369 

G 

/ 

O 

O 

8 

/ 

O 

o 

8 

o 

o 

0 

0 

O 

o 

o 

0  0.6  1.0  1.6  2.0  2J6 

i  3.0  3.6 

4.1 

O 

Single  Data  Point 

o 

Two  Data  Points 

O 

Three  Data  Points 

O 

Four  Data  Points 

o 

Five  Data  Points 

o 

Six  Data  Points 

O 

Eight  Data  Points 

— 

Linear  Fit 

Gap  Criterion 


Data  Basis:  1SK  ft  PA,  300  KIAS 
Tpst  A/D  LAMARS  Simulation 
Acqujdtlon  System;  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Figure  G1  A:  MAX  GAP  Phase  2  Sum-of-Sines  Task  LAMARS  Data  (2D) 


LAMARS  Data  Phase  2  Sunvof-Smes 


Figure  G2B:  MAX  GAP  Phase  2  Sum-of-Sines  Task  LAMARS  Data  (3D) 
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LAMARS  Data  Phase  3  Discrete  HUD  Pitch  Tracking  Task 


Gap  Criterion 


Figure  G2A:  MAX  GAP  Phase  3  HUD  Discrete  Tracking  Task  LAMARS  Data  (2D) 


LAMARS  Data  Phase  3  HUD  Discrete  Task 


PIO  Tendency  Rating  ''  °  Gap  Criterion 


Figure  G2B:  MAX  GAP  Phase  3  HUD  Discrete  Tracking  Task  LAMARS  Data  (3D) 
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VISTA  Flight  Test  Phase  2  Sum-of-SInes 


O  single  Data  Point 


O  Two  Data  Points 
Q  Three  Data  Points 
o  Four  Data  Points 
o  Five  Data  Points 

— Linear  Curve  Fit 


Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-160  66-00048 

Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October 2003 


Figure  G3A:  MAX  GAP  Phase  3  Target  Tracking  Task  LAMARS  Data  (2D) 


LAMARS  Data  Phase  3  Target  Task 


Figure  G3B:  MAX  GAP  Phase  3  HUD  Target  Tracking  Task  LAMARS  Data  (3D) 


MAX  GAP  LAMARS  Test  Data  Configuration:  N  1 5  Record:  54 
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Figure  G4:  Phase  2  Sum-of-Sines,  PIOR:  5 


Time  (seconds) 


Max  GAP  LAMARS  Test  Data  Configuration:  Y  60  Record:  168 
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Figure  G5:  Phase  2  Sum-of-Sines,  PIOR:  1 


Time  (seconds) 
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LAMARS  Data  Phase  2  Sum-of-Sines  Reduced  Dataset 


o  single  Data  Point 
O  Two  Data  Points 
Q  Three  Data  Points 


o 

o 

o 

O 


Four  Data  Points 

Five  Data  Points 

Six  Data  Points 
Eight  Data  Points 


•LInearFIt 


Data  Baste  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acqutetion  S^em:  Hand  Held 
Conflguration:  Cruise 
Test  Pates:  August  2003 


Figure  G6A:  MAX  GAP  Phase  2  Sum-of-Sines  Tracking  Task  LAMARS  Data  Reduced  (2D) 


Figure  G6B:  MAX  GAP  Phase  2  Sum-of-Sines  Tracking  Task  LAMARS  Data  Reduced  (3D) 


Number  of  Occurrences 
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LAMARS  Data  Phase  3  Discrete  HUD  Pitch  Tracking  Task 
(Reduced  Dataset) 

O  single  Data  Points 
O  Two  Data  Points 
(2)  Three  Data  Points 
o  Four  Data  Points 


— Linear  Fit 


Data  Basis:  1SK  ft  PA,  300  KIAS 
Test  A^C:  LAMARS  Simutation 
Acquisition  System;  Hand  Held ; 
Configuration:  Cruise  I 

Test  Dates:  22  August  2003  | 


0.0  0.5  1.0  2.0  2.5  3.0  3.5  4.0 

Gap  Criterion 


6  O 


6  O  O  O 


1  o 


Figure  G7A:  MAX  GAP  Phase  3  Discrete  Tracking  Task  LAMARS  Data  Reduced  (2D) 


Figure  G7B:  MAX  GAP  Phase  3  Discrete  Tracking  Task  LAMARS  Data  Reduced  (3D) 
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APPENDIX  H:  VISTA  DATA  FIGURES 

The  MAX  GAP  flight  test  data  figures  are  in  this  appendix.  There  are  three  types  of 
charts  shown.  One  is  a  2D  “bubble  chart”  of  the  PIO  tendency  rating  versus  the  Gap  Criterion. 
This  “bubble  chart”  uses  circles  of  different  diameters  to  depict  data  density  in  terms  of  the 
number  of  times  a  similar  PIO  tendency  rating  is  assigned  to  a  single  Gap  Criterion  value.  Also, 
a  linear  curve  fit  with  the  corresponding  equation,  value,  and  correlation  factor  are  shown  on 
the  2D  “bubble  chart.”  The  second  type  of  figure  is  a  3D  stem  plot  with  the  same  data  as  the  2D 
“bubble  chart”  from  a  different  perspective.  The  horizontal  plane  of  the  3D  chart  contains  the 
PIO  tendency  rating  and  the  Gap  Criterion.  The  vertical  axis  shows  the  number  of  occurrences 
for  a  single  PIO  tendency  rating  for  a  discrete  Gap  Criterion.  An  increasing  height  of  the 
vertical  bars  corresponds  to  a  greater  number  of  occurrences.  The  same  linear  model  from  the 
2D  “bubble  chart”  is  shown  on  the  floor  of  the  3D  view.  This  provides  insight  into  how  the  data 
density  drives  to  the  model  to  match  the  Gap  Criterion  theory,  which  states  that  low  Gap  values 
should  lead  to  the  high  PIO  tendency  ratings  and  vice  versa.  The  third  chart  shown  contains  time 
histories  of  the  following:  VISTA  longitudinal  center  stick  position;  variation  of  pitch  angle  and 
HUD  task  pitch  angle;  pilot  g;  left  and  right  stab  position;  and  commanded  along  with  actual 
actuator  rate. 


Tendency  Rating 
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VISTA  Flight  Test  Phase  2  Sum-of-SInes 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDUM 


Figure  H2B:  MAX  GAP  Phase  3  Discrete  HUD  Tracking  Task  Flight  Data  (3D) 
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VISTA  Flight  Test  Phase  3  Target  Tracking  Task 
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0.0  1.0  2.0  3.0  4.0  5.0  6.0 


O  Single  Data  Point 
O  Two  Data  Points 
—  Linear  Fit 


Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-16D  -#06-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 


Gap  Criterion 


Figure  H3A:  MAX  GAP  Phase  3  Target  Task  Flight  Data  (2D) 


FLIGHT  Data  Phase  3  Target  Task 


Figure  H3B:  MAX  GAP  Phase  3  Target  Task  Flight  Data  (3D) 


a  eval  02  031020 
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‘ui  aiey 


Figure  H4:  Phase  2  Sum-of-Sines,  PIOR:  5 


MAX  GAP  Flight  Test  Data  eval  08  031022  Record  15  |o5'B.<.isKnPA, 
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Figure  H5:  Phase  2  Sum-of-Sines,  PIOR:  1 


Time  (seconds) 


PIO  Tendency  Rating 
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Figure  H6B:  MAX  GAP  Phase  2  Sum-of-Sines  Task  Flight  Data  Reduced  (3D) 
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VISTA  Flight  Test  Phase  3  Discrete  Pitch  Tracking  Task 
(Reduced  Dataset) 


O  single  Data  Point 
Q  Two  Data  Points 
Q  Three  Data  Points 
—  Linear  Curve  Fit 


Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C  NF.16D  .  #  86-00048 
Acquisition  S^em;  Hand  Held 
Configuration:  Duise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 _ 


Figure  H7A:  MAX  GAP  Phase  3  Discrete  HUD  Tracking  Task  Flight  Data  Reduced  (2D) 


Figure  H7B:  MAX  GAP  Phase  3  Discrete  HUD  Tracking  Task  Flight  Data  Reduced  (3D) 
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VISTA  Flight  Test  Phase  3  Target  Tracking  Task 
(Reduced  Dataset) 
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THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDUM 


73 


APPENDIX  I:  LAMARS  SIMULATOR  HISTOGRAMS 

The  MAX  GAP  LAMARS  test  histograms  are  contained  in  this  appendix.  Pilots  1, 2  and 
3  were  the  same  individual  in  each  case. 
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LAMARS  Data 

PIOR  for  Phase  2  SOS  -  Case  B,  15  deg/sec  Rate  Limit 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Figure  II  LAMARS  Data,  Case  B,  15  deg/sec 


LAMARS  Data 

PIOR  for  Phase  2  SOS  -  Case  B,  30  deg/sec  Rate  Limit 


Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Evaluation  Pilot 


Figure  12  LAMARS  Data,  Case  B,  30  deg/sec 


PIOR  PIOR 
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LAMARS  Data 

PIOR  for  Phase  2  SOS  -  Case  B,  60  deg/sec  Rate  Limit 

Data  Basis;  15K  tt  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Evaluation  Pilot 


Figure  13  LAMARS  Data,  Case  B,  60  deg/sec 


LAMARS  Data 

PIOR  for  Phase  2  SOS  -  Case  N,  15  deg/sec  Rate  Limit 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates;  22  August  2003 


Figure  14  LAMARS  Data,  Case  N,  15  deg/sec 
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Figure  16  LAMARS  Data,  Case  N,  60  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  2  SOS  -  Case  W,  15  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  17  LAMARS  Data,  Case  W,  15  deg/sec 


LAMARS  Data 

PiOR  for  Phase  2  SOS  -  Case  W,  30  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  18  LAMARS  Data,  Case  W,  30  deg/sec 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDl]M__ 


LAMARS  Data 

PIOR  for  Phase  2  SOS  -  Case  W,  60  deg/sec  Rate  Limit 


Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 

Test  Dates:  22  August  2003 
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Figure  19  LAMARS  Data,  Case  W,  60  deg/sec 


LAMARS  Data 

PiOR  for  Phase  2  SOS  -  Case  Y,  15  deg/sec  Rate  Limit 

Data  Basis:  15K  tt  PA,  300  KIA^ 

Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  110  LAMARS  Data,  Case  Y,  15  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  2  SOS  -  Case  Y,  30  deg/sec  Rate  Limit 


Data  Basis;  1SK  tt  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Figure  II 1  LAMARS  Data,  Case  Y,  30  deg/sec 


LAMARS  Data 

PIOR  for  Phase  2  SOS  -  Case  Y,  60  deg/sec  Rate  Limit 

Data  Basis;  15K  tt  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  112  LAMARS  Data,  Case  Y,  60  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  DIS  -  Case  B,  15  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  113  LAMARS  Data,  Case  B,  15  deg/sec 


LAMARS  Data 

PiOR  for  Phase  3  DiS  -  Case  B,  30  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C;  L/tMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Pates:  22  August  2003 
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Figure  114  LAMARS  Data,  Case  B,  30  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  DIS  -  Case  B,  60  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  WAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  115  LAMARS  Data,  Case  B,  60  deg/sec 


LAMARS  Data 

PiOR  for  Phase  3  DIS  -  Case  N,  15  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  116  LAMARS  Data,  Case  N,  15  deg/sec 


82 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDUM 


LAMARS  Data 

PIOR  for  Phase  3  DIS  -  Case  N,  30  deg/sec  Rate  Limit 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration;  Cruise 
Test  Dates:  22  August  2003 
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Evaluation  Pitot 


Figure  117  LAMARS  Data,  Case  N,  30  deg/sec 


LAMARS  Data 

PiOR  for  Phase  3  DIS  -  Case  N,  60  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  118  LAMARS  Data,  Case  N,  60  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  DIS  -  Case  W,  15  deg/sec  Rate  Limit 

Data  Basis;  1 5K  ft  PA,  300  Kl AS 
Test  A/C;  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Figure  119  LAMARS  Data,  Case  W,  15  deg/sec 


LAMARS  Data 

PiOR  for  Phase  3  DIS  -  Case  W,  30  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  120  LAMARS  Data,  Case  W,  30  deg/sec 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDUM 


LAMARS  Data 

PIOR  for  Phase  3  DIS  -  Case  W,  60  deg/sec  Rate  Limit 
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Figure  121  LAMARS  Data,  Case  W,  60  deg/sec 


LAMARS  Data 

PiOR  for  Phase  3  DiS  -  Case  Y,  15  deg/sec  Rate  Limit 

Data  Basis;  15K  tt  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  122  LAMARS  Data,  Case  Y,  15  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  DIS  •  Case  Y,  30  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Evaluation  Pilot 


Figure  123  LAMARS  Data,  Case  Y,  30  deg/sec 


LAMARS  Data 

PIOR  for  Phase  3  DIS  -  Case  Y,  60  deg/sec  Rate  Limit 

Data  Basis:  1SK  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Figure  124  LAMARS  Data,  Case  Y,  60  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  B,  15  deg/sec  Rate  Limit 

Data  Basis;  1SK  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Evaluation  Pilot 


Figure  125  LAMARS  Data,  Case  B,  15  deg/sec 


LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  B,  30  deg/sec  Rate  Limit 

Data  Basis:  15K  n  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  126  LAMARS  Data,  Case  B,  30  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  B,  60  deg/sec  Rate  Limit 

Data  Basis;  15K  n  PA,  300  KIAS 
Test  A/C;  LAMARS  Simulation 
Acquisition  System;  Hand  Held 
Configuration;  Cruise 
Test  Dates;  22  August  2003 
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Figure  127  LAMARS  Data,  Case  B,  60  deg/sec 


LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  N,  15  deg/sec  Rate  Limit 

Data  Basis:  15K  R  PA,  300  KIAS 

Test  A/C:  LAMARS  Simulation 

Acquisition  System:  Hand  Held 

Configuration:  Cruise 
Test  Dates:  22  August  2003 


Figure  128  LAMARS  Data,  Case  N,  15  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  N,  30  deg/sec  Rate  Limit 

Data  Basis;  15K  ft  PA,  300  KIAS 

Test  A/C:  LAMARS  Simulation 

Acquisition  System:  Hand  Held 

Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  129  LAMARS  Data,  Case  N,  30  deg/sec 


LAMARS  Data 

PiOR  for  Phase  3  TGT  -  Case  N,  60  deg/sec  Rate  Limit 

Data  Basis:  15Kft  PA.  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  130  LAMARS  Data,  Case  N,  60  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  W,  15  deg/sec  Rate  Limit 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
AcquIsKion  System:  Hand  Held 
Configuration:  Cruise 
Test  Pates:  22  August  2003 
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Figure  131  LAMARS  Data,  Case  W,  15  deg/sec 


LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  W,  30  deg/sec  Rate  Limit 

Data  Basis:  1SK  ft  PA,  300  KIAS 

Test  A/C;  LAMARS  Simulation 

Acquisition  System:  Hand  Held 

Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  132  LAMARS  Data,  Case  W,  30  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  W,  60  deg/sec  Rate  Limit 

Data  Basis;  15K  ft  PA,  300  KiAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  133  LAMARS  Data,  Case  W,  60  deg/sec 


LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  Y,  15  deg/sec  Rate  Limit 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 
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Figure  134  LAMARS  Data,  Case  Y,  15  deg/sec 
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LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  Y,  30  deg/sec  Rate  Limit 

Data  Basis:  1 5K  tt  PA,  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Evaluation  Pilot 


Figure  135  LAMARS  Data,  Case  Y,  30  deg/sec 


LAMARS  Data 

PIOR  for  Phase  3  TGT  -  Case  Y,  60  deg/sec  Rate  Limit 

Data  Basis:  15K  n  PA.  300  KIAS 
Test  A/C:  LAMARS  Simulation 
Acquisition  System:  Hand  Held 
Configuration:  Cruise 
Test  Dates:  22  August  2003 


Figure  136  LAMARS  Data,  Case  Y,  60  deg/sec 
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APPENDIX  J:  VISTA  FLIGHT  HISTOGRAMS 

The  MAX  GAP  VISTA  flight  test  histograms  are  in  this  appendix.  Pilots  1, 2  and  3  were  the 
same  individual  in  each  case 
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MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  B  - 15  deg/sec 


Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-16D  -#  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 


Evaluation  Pilot 


Figure  J1  Flight  Test  Data,  Case  B,  15  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  B  -  30  deg/sec 


Data  Basis;  1 5K  tt  PA,  300  KIAS 
Test  MC:  NF-1 6D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 


Figure  J2  Flight  Test  Data,  Case  B,  30  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  B  -  60  deg/sec 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-16D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J3  Flight  Test  Data,  Case  B,  60  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  N  - 15  deg/sec 

Data  Basis:  1SK  ft  PA,  300  KIAS 
Test  AC:  NF-16D  -#  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J4  Flight  Test  Data,  Case  N,  15  deg/sec 


PIO  Tendecy  Rating  PIO  jendecy  Rating 


96 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDUM 


MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  N  -  30  deg/sec 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-16D  -  #  86-00048 
Acquisition  System;  Hand  Held 
Configuration;  Cruise/ VSS  Engaged 
Test  Dates;  20-22  October  2003 


Evaluation  Pilot 


Figure  J5  Flight  Test  Data,  Case  N,  30  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  N  -  60  deg/sec 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C;  NF-1 6D  -  *  86-00048 
Acquisition  System:  Hand  Held 
Configuration;  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J6  Flight  Test  Data,  Case  N,  60  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  W  - 15  deg/sec 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C;  NF-1 6D  -  #  B6-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 


Figure  J7  Hight  Test  Data,  Case  W,  15  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  W  -  30  deg/sec 

Data  Basis:  15K  tt  PA,  300  KIAS 
Test  AlC:  NF-1 6D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J8  Hight  Test  Data,  Case  W,  30  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  W  -  60  deg/sec 

Data  Basis:  15K  tt  PA,  300  KIAS 
Test  AlC:  NF-16D  -  *  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 


Evaluation  Pilot 


Figure  J9  Flight  Test  Data,  Case  W,  60  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  Y  - 15  deg/sec 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-16D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 


Figure  JIO  Flight  Test  Data,  Case  Y,  15  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  Y  >  30  deg/sec 

Data  Basis:  1SK  ft  PA.  300  Kl^ 

Test  A/C:  NF-16D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration;  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 


1  2 
Evaluation  Pilot 


Figure  Ill  Flight  Test  Data,  Case  Y,  30  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  2  SOS  -  Case  Y  -  60  deg/sec 

Data  Basis:  15K  ft  PA,  300  WAS 
Test  A/C:  NF-16D-#  86-00048 
Acquisition  System;  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J12  Flight  Test  Data,  Case  Y,  60  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  B  - 15  deg/sec 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  NM  6D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J13  Flight  Test  Data,  Case  B,  15  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  B  -  30  deg/sec 

Data  Basis;  15K  tt  PA.  300  KIAS 
Test  A/C:  6D  -  #  86-00048 

Acquisition  System:  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J14  Flight  Test  Data,  Case  B,  30  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  B  -  60  deg/sec 

Data  Basis:  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-16D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise/ VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J15  Flight  Test  Data,  Case  B,  30  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  N  - 15  deg/sec 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  AC:  NF-1 6D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise/ VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J16  Flight  Test  Data,  Case  N,  15  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  N  -  30  deg/sec 

Data  Basis;  15K  n  PA,  300  KIAS 
Test  A/C;  NF-16D  -  *  86-00048 

Acquisition  System:  Hand  Held 
Configuration;  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 


Figure  J17  Flight  Test  Data,  Case  N,  30  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  N  -  60  deg/sec 

Data  Basis;  1 5K  n  P/t.  300  KIAS 
Test  A/C;  NF-1 6D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J18  Flight  test  Data,  Case  N,  60  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  W  - 15  deg/sec 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-16D  -  »  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 


Figure  J19  Flight  Test  Data,  Case  W,  15  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  W  -  30  deg/sec 

Data  Basis:  1SK  n  PA,  300  KIAS 
Test  A/C:  NF-1 6D  -  «  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 


Figure  J20  Flight  Test  Data,  Case  W,  30  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  W  -  60  deg/sec 

Data  Basis:  1SK  tt  PA,  300  KIAS 
Test  A/C:  NF-1 6D  -  #  86-00048 
AcquIsHion  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Figure  J21  Flight  Test  Data,  Case  W,  60  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  Y  - 15  deg/sec 

Data  Basis;  15K  tt  PA,  300  KIAS 
Test  ATC;  NF-1 6D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20*22  October  2003 


Figure  J22  Flight  Test  Data,  Case  Y,  15  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  DIS  -  Case  Y  -  30  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  B  - 15  deg/sec 

Data  Basis:  15K  ft  PA,  300  KJAS 
Test  A/C:  NF.16D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 


Evaluation  Pilot 


Figure  J25  Flight  Test  Data,  Case  B,  15  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  B  -  30  deg/sec 

Data  Basis:  1 5K  ft  PA,  300  KIAS 
Test  A/C:  NF-1 6D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise/ VSS  Engaged 
Test  Dates:  20-22  October  2003 


Evaluation  Pilot 


Figure  J26  Flight  Test  Data,  Case  B,  30  deg/sec 


PIO  Tendecy  Rating  PIO  Tendecy  Rating 


MAX  GAP  TECHNICAL  INFORMATION  MEMORANDUM 


MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  B  -  60  deg/sec 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-16D  -  #  8S-0(K)48 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Evaluation  Pilot 


Figure  J27  Flight  Test  Data,  Case  B,  60  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  N  - 15  deg/sec 

Data  Basis:  1 5K  ft  PA,  300  KIAS 
Test  ATC:  NF-1 6D  -  #  88^)0048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise /VSS  Engaged 
Test  Dates:  20-22  October  2003 
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Evaluation  Pilot 
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Figure  J28  Flight  Test  Data,  Case  N,  15  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  N  -  30  deg/sec 


Evaluation  Pilot 

Figure  J29  Flight  Test  Data,  Case  N,  30  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  N  -  60  deg/sec 

Data  Basis;  15K  ft  PA,  300  KIAS 
Test  A/C:  NF-1 6D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 


Evaluation  Pilot 


Figure  J30  Flight  Test  Data,  Case  N,  60  deg/sec 
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Figure  J32  Flight  Test  Data,  Case  W,  30  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  W  -  60  deg/sec 

Data  Basis;  1SKft  PA,  300  KIAS 
Test  A/C:  NF-1 60  -  »  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20>22  October  2003 


Evaluation  Pilot 


Figure  J33  Flight  Test  Data,  Case  W,  60  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  Y  - 15  deg/sec 

Data  Basis:  1SK  n  P/t,  300  KIAS 
Test  A/C:  NF-1 6D  -  #  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise/ VSS  Engaged 
Test  Dates:  20-22  October  2003 


Evaluation  Pilot 


Figure  J34  Hight  Test  Data,  Case  Y,  15  deg/sec 
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MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  Y  -  30  deg/sec 


Data  Basis;  15K  ft  PA,  300  KIAS 
Test  fiJC:  NF-16D  -  #  86-00048 
Acquisitfon  System:  Hand  Held 
Configuration:  Cruise/ VSS  Engaged 
Test  Dates:  20*22  October  2003 


Evaluation  Pilot 


Figure  J35  Flight  Test  Data,  Case  Y,  30  deg/sec 


MAX  GAP  Flight  Test  Data 
Phase  3  TGT  -  Case  Y  -  60  deg/sec 


Data  Basis;  1 5K  ft  PA,  300  KIAS 
Test  A/C;  NF-1 6D  -  *  86-00048 
Acquisition  System:  Hand  Held 
Configuration:  Cruise  /  VSS  Engaged 
Test  Dates:  20-22  October  2003 


Figure  J36  Flight  Test  Data,  Case  Y,  60  deg/sec 
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APPENDIX  K:  LESSONS  LEARNED 

The  MAX  GAP  lessons  learned  are  contained  in  this  appendix. 

1.  The  selection  of  tracking  tasks  used  to  determine  PIO  tendency  ratings  proved  to  be 
critical  to  the  quality  of  the  assigned  rating.  The  task  must  be  repeatable  and  must  be 
designed  to  isolate  any  undesired  effects.  The  Phase  3  target  tracking  task  should  be 
redesigned  to  ensure  repeatability  and  to  induce  high-gain  pilot  inputs  during  capture  and 
tracking. 

2.  Variability  of  PIO  tendency  ratings  occurred  expectedly  between  test  pilots.  Variability 
of  PIO  tendency  ratings  assigned  by  the  same  test  pilot  for  the  same  test  case  from  the 
same  tracking  task  should  not  occur.  Every  effort  should  be  made  to  eliminate  this  effect 
to  increase  the  validity  of  the  assigned  ratings.  Calibration  of  test  pilots  should  be 
conducted  prior  to  each  test  phase  to  enhance  ability  to  identify  and  rate  PIO 

3.  Even  after  precisely  defining  and  controlling  the  task  and  calibrating  test  pilots,  data 
scatter  occurred.  A  stringent  method  of  determining  data  validity  must  be  determined  in 
an  effort  to  “weed-out”  bad  data  points  from  true  data  scatter.  Stringent  criteria  for 
screening  questionable  data  points  should  be  defined  during  the  test  planning  phase. 
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LIST  OF  ACRONYMS 


a 

deg 

Ka 

K, 

0task 

0act 

q 

rad 

sec 


Angle  of  Attack 
Degrees 

Angle  of  Attack  Feedback  Gain 

Pitch  Rate  Feedback  Gain 

Pitch  angle  commanded  by  the  tracking  task 

Actual  aircraft  pitch  angle 

Pitch  Rate 

Radian 

Second 

Short  Period  Natural  Frequency 


Short  Period  Damping 

AFB  Air  Force  Base 

AFFTC  Air  Force  Flight  Test  Center 

AFIT/ENY  Air  Force  Institute  of  Technology,  Aeronautics  Department 

EP  Evaluation  Pilot 

FCS  Flight  Control  System 

HQ  Handling  Qualities 

HQDT  Handling  Qualities  During  Tracking 

HUD  Head’s-Up  Display 

ID  Identification 

JON  Job  Order  Number 

KIAS  Knots  Indicated  Airspeed 

LAMARS  Large  Amplitude  Multimode  Aerospace  Research  Simulator 

OLOP  Open  Loop  Onset  Point 

PA  Pressure  Altitude 

PIO  Pilot-Induced  Oscillation 

PIOR  Pilot-Induced  Oscillation  Tendency  Rating 

RTO  Responsible  Test  Organization 

SP  Safety  Pilot 

TIM  Technical  Information  Memorandum 

TM  Telemetry 

TMP  Test  Management  Project 
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TPS  Test  Pilot  School 

USAF  United  States  Air  Force 

VISTA  Variable  Stability  In-Flight  Simulator  Test  Aircraft 

VSS  VISTA  Simulation  System 
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